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SUMMAR7 


The  purpose  of  this  document  is  to  report  the  first  results  from  a 
series  of  experiments  establishing  and  optimizing  the  utility  of  the 
Vertical  Contact  Analog  Display  (VCAD) .  The  VCAD  concept  is  that  of  a 
computer-generated  pictorial  display  which  provides  the  observer  with 
visual  cues  as  to  aircraft  orientation.  These  cues  are  analogous  to 
those  available  under  contact  flight  conditions.  The  specific  objectives 
of  this  experiment  series  were:  (1)  to  establish  the  relationship 
between  size  of  VCAD  display  and  judgment  accuracy  for  altitude,  pitch, 
and  roll  estimates,  and  (2)  to  obtain  estimates  of  the  accuracy  with 
which  these  quantities  may  be  judged.  Four  studies  were  conducted  to 
measure  Ss  ability  to  "maintain"  a  given  standard  against  a  forcing 
function  and  three  studies  were  conducted  to  measure  Ss  ability  to 
recall  and  utilize  an  "internalized  standard."  Both  types  of  experiments 
were  conducted  for  each  of  the  three  flight  related  quantities.  The 
experimental  designs  for  each  of  these  experiments  were  fractional 
replicates  with  repeated  measures.  The  analytic  procedure  consisted  of 
the  fitting  of  "response  surface"  models  and  the  graphical  representation 
of  these  models.  It  was  concluded  that  display  size  had  an  effect  on  the 
accuracy  for  each  of  the  three  flight  quantities,  but  the  nature  of  the 
effect  depended  on  both  the  type  of  judgment  task  ("maintenance"  vs. 
recalled  "standard”)  and  the  magnitude  of  the  standard  being  judged. 
Generally  the  effect  was  more  pronounced  for  the  "maintenance’'  experiments. 
The  results  of  the  experiments  as  i  unit  suggest  the  optimal  display 
traverses  a  diagonal  visual  angle  of  18.6  degrees  for  commercial-rectangular 
displays  (e.g.,  a  commercially  designated  11-inch  display  at  a  32-inch 
viewing  distance) . 
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INTRODUCTION 


The  Vertical  Contact  Analog  Display  (VCAD)  concept  is  that  of  a 
computer-generated  pictorial  display  which  provides  the  observer  with 
visual  cues  as  to  aircraft  orientation  that  are  closely  analogous  to 
those  obtained  from  an  aircraft  cockpit  under  contact  flight  conditions. 

The  central  theme  of  the  VCAD  concept  is  that  a  digital  computer,  which 
maintains  "awareness"  of  aircraft  orientation  and  location  through  the 
continuous  monitoring  of  sensor  outputs,  generates  a  dynamic,  three- 
dimensional  appearing  picture  of  a  textured  grcund  and  sky  plane  that 
corresponds  closely  with  the  "real-vorld"  view  that  would  be  obtained 
from  the  aircraft's  current  orientation  and  location  in  space.  It  was 
originally  hypothesized  that  presentation  of  such  a  display  on  a  cockpit 
mounted  raster-scan  tube  would  provide  a  pilot  with  considerable  flight 
information  in  a  highly  integrated  format. 

The  purpose  of  the  JANAIR  VCAD  Evaluation  Program  is  to  evaluate  the 
utility  of  the  VCAD  concept  for  use  in  a  variety  of  Army  and  Navy  aircraft. 
Because  little  systematic  research  has  been  conducted  previously,  the 
initial  phase  of  this  program  is  necessarily  exploratory  in  nature.  Initial 
efforts  have  been  directed  at  two  rather  broad  areas  of  uncertainty.  The 
first  stems  from  the  fact  that  a  number  of  differently  configured  displays 
can  be  designed,  all  of  which  can  be  considered  as  falling  within -the  gen¬ 
eral  framework  of  the  VCAD  concept.  There  is  considerable  uncertainty  as 
to  which  configuration (s)  would  be  most  conducive  to  accurate  and  rapid 
information  extraction.  Although  a  large  number  of  VCAD  characteristics 
are  changeable,  those  of  primary  interest  during  the  first  phase  of  the 
program  include:  (a)  the  size,  shape,  and  density  of  both  sky  and  ground 
texture,  (b)  the  display  viewing  angle,  (c)  the  position  of  texture  break¬ 
points,  and  (d)  the  size  of  CRT  on  which  the  VCAD  is  presented.  The 
experiments  reported  here  deal  with  the  latter  of  these  characteristics, 
viz.,  display  size. 

Uncertainty  also  exists  as  to  the  accuracy  with  which  the  information 
necessary  for  maintenance  of  aircraft  control  can  be  extracted  from  the 
VCAD.  It  is  therefore  necessary  to  obtain  reliable  predictions  of  the 
accuracy  with  which  observers  can  estimate  certain  flight  quantities  from 
the  VCAD. 

Thus  the  objectives  of  the  experiments  reported  here  can  be  stated 
as  follows:  (a)  to  define  the  relationship  between  display  size  and  the 
accuracy  of  judging  certain  flight  parameters  and  (b)  to  obtain  reliable 
estimates  of  the  absolute  accuracy  with  which  these  flight  parameters 
can  be  judged. 


The  introduction  to  this  report  was  written  with  the  assumption  that 
the  reader  has  some  familiarity  with  the  characteristics  of  the  General 
Electric  Vertical  Contact  Analog  Display.  Those  readers  not  familiar 
with  the  display  are  advised  to  read  the  "apparatus"  section  of  this 
report  before  proceeding  further. 


Preceding  Page  Blank 
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BACKGROUND 


Because  of  the  very  obvious  Implications  that  display  size  has  upon 
apace  and  weight  requirements  in  he  cockpit,  it  is  surprising  that 
researchers  have  not  directed  sore  attention  to  this  variable.  Only  two 
Studios  hove  been  found  which  have  a  direct  bearing  on  the  relationship 
between  display  size  and  flight  proficiency.  Wilkerson  and  Matheny 
(1961)  investigated  the  effect  of  "display  size"  on  hovering  performance 
In  a  Model  47-H1  Bell  Helicopter.  The  "display"  in  this  study  was  the 
real  world,  end  "size"  was  varied  by  varying  the  sl2e  of  opening  that 
was  cut  in  an  opaque  lining  which  otherwise  masked  the  view  from  a 
helicopter  cockpit.  Four  conditions  were  investigated:  (a)  the  normal 
view  obtained  from  the  right  seat  of  a  Model  47-H1  helicopter,  (b)  an 
8-lnch  square  opening  cut  in  the  opaque  lining  that  was  located  such 
that  tha  horizon  would  appear  in  the  center  of  the  vertical  dimension 
when  the  helicopter  wes  in  s  hover,  (c)  an  8-lnch  square  opening  located 
adjacent  to  end  directly  below  the  first,  and  (d)  the  lower  8-inch  square 
opening  was  replaced  by  sn  8-inch  high  by  16-inch  wide  rectangular  open¬ 
ing,  otherwise  the  arrangement  was  the  same  as  that  described  in  (c) 
above.  None  of  these  four  arrangements  were  found  to  exert  a  signifi¬ 
cantly  different  influence  on  hovering  performance.  Similarly, 

Fadderson  (1962)  compared  hovering  performance  when  using  an  8-lnch 
Contact  Analog  Display  with  performance  on  a  14-inch  display.  Performance 
was  seasursd  In  the  Bell  Helicopter  Simulation  Laboratory  using  the  six- 
degree-of-freedon  dynamic  platform  developed  by  Franklin  Institute.  No 
statistically  reliable  differences  in  performance  were  found  for  the  two 
display  sites. 

Despite  the  fact  that  both  of  these  studies  indicate  that  display 
site  has  no  measurable  effect  on  flight  proficiency,  several  design 
features  limit  the  degree  to  which  these  findings  can  be  generalized. 

First,  the  evaluation  of  the  different  display  sizes  was  limited  to  a 
hovering  task— a  highly  specialized  task  with  rather  unique  display 
requirements.  10  generalize  the  conclusion  of  these  studies  to  other 
type3  of  aircraft  and  to  other  mission  segments  would  appear  to  be 
extremely  risky. 

A  related  point  concerns  the  nature  of  the  hovering  task  itself.  It 
is  a  well  known  fact  that  hovering  is  a  difficult  and  complex  task  which 
places  large  demands  on  the  perceptual-motor  skill  of  the  pilot.  An  over¬ 
simplified  description  of  this  perceptual-motor  task  is  that  the  pilot 
must  first  perceive  a  deviation  from  hover  by  "decoding"  his  display, and 
after  completing  appropriate  information  integration  and  decision  making 
activities,  he  must  Introduce  corrective  response  by  manipulating  his 
controls  (response  "encoding").  The  point  to  be  made  is  that  although 
both  decoding  and  encoding  errors  contribute  to  the  overall  task  variance, 
it  is  probable  that  encoding  is  the  limiting  process  in  the  hovering  task. 
That  la,  it  seems  probable  that  the  pilot  can  detect  deviations  from  hover 
much  more  accurately  than  he  can  introduce  corrections  for  these  deviations. 
If  this  Is  indeed  the  case,  even  rather  large  differences  In  the  accuracy 
with  which  different  size  displays  can  be  decoded  would  be  masked  by  the 
even  larger  variability  Introduced  during  the  response  encoding  process. 


Other  limiting  features  of  these  studies  ran  he  enumerated.  Pnr 
example,  as  Fedderson  (1962)  has  pointed  out  himself,  the  fact  that 
the  performance  data  on  the  two  different  size  displays  were  collected 
at  different  times  could  possibly  have  affected  the  result.  An  even 
more  serious  shortcoming  was  that  the  performance  tasks  for  the  two 
displays  were  not  the  same.  The  task  associated  with  the  14-ineh 
display  required  the  subjects  (Sb )  to  control  position,  attitude,  alti¬ 
tude,  rotor  rpm,  and  manifold  pressure.  In  contrast,  the  task  associ¬ 
ated  with  the  8-inch  display  required  Ss  to  control  only  position  and 
attitude,  a  considerably  easier  task  than  va6  required  for  the  14-inch 
display. 

Whether  this  confounding  of  variables  resulted  in  biased  conclu¬ 
sions  being  drawn  from  these  studies  is  not  known.  However,  It  la 
believed  that  the  probability  of  such  an  occurrence  is  sufficiently 
high  to  warrant  further  investigation  of  the  effect  of  display  alze  on 
the  accuracy  with  which  the  VCAD  can  be  decoded. 

Stimulus  Configuration;  Defined 

It  is  a  truism  that  a  thorough  understanding  of  the  stimulus  con¬ 
figuration  in  each  experimental  condition  is  absolutely  essential  if 
the  indications  of  research  results  are  to  be  fully  understood  and  if 
results  are  to  be  intelligently  generalized  to  non-laboratory  situations. 
A  careful  examination  of  the  information  parameters  which  are  coded  on 
the  VCAD,  and  the  way  in  which  these  coded  cues  change  as  a  function  of 
display  size  is  necessary  in  order  to  fully  define  the  stimulus  con¬ 
figuration  and  to  understand  the  manner  in  which  the  stimulus  configur¬ 
ation  changes  as  a  function  of  display  Bize. 

Consider  first  the  informatinn  parameters  that  are  necessary  If 
the  pilot  Is  to  maintain  an  awareness  of  his  aircraft's  orientation  in 
space.  An  information  analysis  conducted  by  the  Norden  Division  of 
United  Aircraft  Corporation  provides  a  partial  answer  to  this  question 
(see  Williams,  1965;  and  Williams  and  Kronhom,  1965).  Information 
requirements  were  defined  for  representative  missions  of  three  different 
fixed-wing  aircraft,  one  rotary-wing  aircraft,  and  one  VTOL  aircraft. 

The  information  parameters  found  to  be  common  to  all  aircraft  and  all 
mission  segments  investigated  are  listed  in  the  left-hand  column  of 
table  1  and  entitled  "Flight  Parameters." 

Considering  each  of  the  flight  parameters  individually,  the  VCAD 
was  examined  to  determine  what  features  of  the  display  (if  any)  change 
as  a  direct  function  of  changes  In  the  value  of  the  flight  parameter  in 
question.  For  example,  if  altitude  is  increased  while  all  other  parame¬ 
ters  are  held  constant,  one  notes  the  following  changes  in  the  display 
features:  (a)  the  size  of  the  ground  texture  elements  decreases,  (b) 
the  rate  at  which  ground  texture  elements  flow  from  the  horizon  to  the 
bottom  edge  of  the  display  become  less,  (c)  the  texture  breakpoints 
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T«M*  1  ft  luLnMiUii  am  fk*  Ruftlr  VC  AD 


Plight  Parameters 


Estimates  Based  Upon 


Altitude 


Roll  Angle 


Pitch  Angle 


Airspeed 


Site  o£  ground  texture,  angular  velocity  of  ground 
texture  relative  to  current  speed,  position  of 
texture  breakpoints,  and  angle  of  convergence  of 
perspective  lines  formed  by  ground  texture  elements 

Inclination  of  the  horizon  line  and  inclination  of 
the  perspective  lines  formed  by  the  sky  and  ground 

texture  elements. 

Ratio  of  visible  ground  area  to  visible  sky  area 
(when  the  horizon  line  falls  within  the  field  of 
view  of  the  display).  Position  of  zenith  marker 
and  retinal  shape  of  the  sky  texture  elements 
(when  the  horizon  is  below  the  display  field  of 
view).  Retinal  shape  of  ground  texture  elements 
and  position  of  texture  breakpoints  (when  the 
horizon  line  Is  above  the  display  field  of  view). 

Angular  velocity  of  ground  texture  elements  rela¬ 
tive  to  current  altitude. 


Heading  Angle  Angle  of  regard  of  sky  and  ground  texture  elements. 

Angular  velocity  of  ground  texture  elements  in  a 
Sideslip  direction  perpendicular  to  the  longitudinal  axis 

of  the  aircraft  (relative  to  current  altitude). 


Angle  of  Attack 


Ratio  of  visible  ground  area  to  visible  sky  area 
relative  to  the  aircraft's  velocity  vector. 


sweep  toward  the  bottom  edge  of  the  display,  and  (d)  the  angle  of  con¬ 
vergence  of  perspective  lines  decreases,  thus  causing  perspective  lines 
to  appear  more  parallel.  Such  an  analysis  serves  to  identify  the  popu¬ 
lation  of  display  features  that  could  possibly  cue  the  observer  as  to 
the  current  value  of  any  one  of  the  flight  parameters  listed  in  table  1. 
The  features  found  to  be  associated  with  each  of  the  flight  parameters 
are  shown  in  the  right-hand  column  of  table  1.  Any  estimate  of  the 
value  of  the  flight  parameters  must  be  obtained  through  observation  of 
this  population  of  display  features. 


Summarizing  table  1,  it  can  be  seen  that  the  population  of  display 
features  mat  serve  as  prospective  cues  for  one  or  more  of  the  flight 
parameters  indues:  (a)  ground  texture  size,  (b)  position  of  texture 
breakpoints,  (c)  inclination  of  horizon  line  and  perspective  lines, 

(d)  angular  velocity  of  ground  texture,  (e)  angle  of  convergence  of 
perspective  lines,  (f)  position  of  horizon  line  in  vertical  plane, 

(g)  retinal  shape*  of  ground  texture,  and  (h)  angle  of  regard  of  sky 
and  ground  texture. 


Having  identified  the  critical  features  of  the  stimulus  configuration, 
the  task  at  hand  is  to  define  the  effect  which  modification  of  display 
size  would  have  upon  each  of  these  eight  display  features.  Where  a  dis¬ 
play  feature  is  found  to  be  measurably  different  from  one  display  size 
to  another,  we  ask  ourselves,  ''Would  the  resulting  change  lead  one  to 
expect  that  the  display  feature  in  question  would  be  more  or  less  dis- 
cernable,  depending  upon  display  size?"  An  affirmative  answer  to  this 
question  would  lead  one  to  predict  that  the  accuracy  with  which  the 
associated  flight  parameter  could  be  estimated  would  be  similarly  affected 
if,  in  fact,  that  display  feature  was  being  attended  to.  Each  of  the 
display  features  listed  above  will  be  discussed  in  turn. 

Ground  Texture  Size 


If  display  viewing  angle^  is  held  constant  while  display  size 
is  varied,  it  can  be  shown  that  the  linear  size  of  all  elements 


The  term  "retinal  shape"  refers  to  the  shape  of  an  image  falling  on 
the  retina.  Retinal  shape  may  or  may  not  correspond  with  the  apparent 
shape  of  an  object;  i.e.,  the  perceived  shape.  Discrepancies  between 
retinal  shapes  cad  apparent  shapes  provide  information  as  to  the  per¬ 
spective  from  which  an  object  is  being  viewed. 

Display  viewing  angle  refers  to  the  angular  extent  of  the  world  which 
is  displayed  on  the  VCAD.  A  graphical  definition  can  be  found  in 
figure  1  (see  angle  a).  It  should  also  be  pointed  out  here  char,  both 
viewing  distance  (distance  of  VCAD  from  S)  and  display  viewing  argle 
were  held  constant  in  all  experiments.  Holding  these  quantities  con- 
while  varying  dUplay  remit  It  a  In  the  lack  of  a  one-to-one 

co.-respondence  between  certain  display  features  and  the  real  world. 
Specifically,  the  shapes  of  both  sky  and  ground  texture  are  slightly 
distorted  and  the  degree  of  movement  of  the  VCAD  horizon  line  that 
results  from  a  given  increment  in  pitch  differs  from  display  to  display 
and  differs  from  what  would  be  seen  if  the  real  world  were  being  observed 
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appearing  on  the  display  varies  in  direct  proporation  to  display  size. 
However,  a  description  of  changes  in  the  stimulus  configuration  must 
be  expressed  in  terms  of  the  changes  that  take  place  at  the  eye 
rather  than  those  which  take  place  at  the  display.  For  this  reason, 
the  effects  of  display  size  upon  ground  texture  size  will  be  discussed 
in  terms  of  the  "visual  angle'*  subtended  by  toe  ground  texture  elements. 
The  visual  angle  subtended  by  any  object  situated  perpendicular  to  the 
line  of  sight  may  be  defined  as  follows: 


a  »  2  tan  1  ^  (D 

where  a  -  visual  angle 

h  »  height  (width)  of  object  being  viewed 
d  «  distance  between  the  eye  and  the  midpoint 
of  the  object  being  viewed 


Examination  of  a  table  of  trigonometric  functions  shows  that  the  tangent 
function  is  nearly  linear  over  a  limited  range  of  values  and  that 
tan  a  ■  a(in  radians)  throughout  this  range.  Over  the  range  of  values 
of  interest  here,  0  to  15  degrees,  it  can  be  shown  that  the  maximum 
error  resulting  from  this  approximation  is  .0061  radians  or  about  one- 
third  degree.  Applying  this  approximation  to  equation  1,  the  following 
simplified  expression  may  be  derived: 


a 


—  (expressed  in  radians) 


(2) 


It  has  already  been  stated  that  the  size  of  an  element  of  ground 
texture  is  directly  proportional  to  the  sice  of  display  upon  which  it 
is  presented.  Equation  2  shows  that  the  visual  angle  is,  in  turn,  very 
nearly  proportional  to  the  measured  size  of  that  element.  Therefore, 
the  visual  angle  subtended  by  an  element  of  ground  texture  can  be 
considered  to  be  a  linear  function  of  display  size  within  the  range 
of  angles  specified  above. 


The  VCAD  is  constructed  such  that  ground  texture  elements  expand 
and  contract  in  size  as  an  inverse  function  of  altitude.  This  expansion 
and  contraction,  or  more  specifically  the  expansion  and  contraction  of 
the  visual  angle  subtended  by  ground  texture  elements,  serves  as  a 
"yardstick"  by  which  altitude  can  be  judged.  We  are  concerned  here 


3.  Cont. 

from  a  corresponding  point  in  the  sky.  The  distortion  in  the  shape 
of  ground  and  sky  texture  could  not  be  detected  by  any  of  the  Ss 
used  nor  were  there  any  detectable  differences  among  the  different 
displays  used.  The  lack  of  real  world  correspondence  in  pitch  angle 
will  be  discussed  in  more  detail  in  a  later  section. 
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with  the  question  of  whether  the  sensitivity  of  this  "vard.n^v"  .«.<.» 
uxner  aepenoing  upon  the  size  of  display  belne  viewed'  Th* 
of  interest,  then,  is  the  relationshipP 

other. P*r  tncr#1'*nt  ln  on  the  one  hand,  and  display^iz.  on  the 

in  .ihLT111  wf  change  ln  v1**1*1  «ngle  resulting  fro*  a  given  change 
t™2f2h  «f\bC  fXpre88ed  elther  in  ter*8  of  relative  change  or  “* 

thlTrii-jJ  l0£*  a?*e‘  U  ghould  be  apparent  from  the  abom  discussion 

that  reiative  change  in  visual  angle  is  independent  of  display  size  whereas 

llneaIly  related  t0  dlaplay  8*~*  To  m2*S5,  col* 

wl?ra^ndnfieie,,ent  8UJtendln*  4-degrees  visual  angle  on  one  display 
will  subtend  8-degrees  visual  angle  on  a  display  twice  as  laroe  An  I----, 

ilB  !uti^U<,e  8“fflclent  to  reduce  texture  size  by  one-half  on  the 

wlll.alao  reduce  texture  size  by  exactly  one-half  on  the 
larger  of  the  two.  Consequently,  whereas  relative  change  is  seen  to  be 
the  same  for  both  displays  (50  percent),  absolute  change  la  twice  aa 
great  for  the  larger  display  (2-degreea  versus  4-degrees). 

q2atl?n  th*S  flnally  *®*r®*8  i«  whether  the  ability  to  judge 
or  th  11  2  ,1“  of  an  obJect  1«  primarily  a  function  of  thi  absolute 
or  the  relative  change  in  the  size  of  an  object.  Because  similar  Question- 
concerning  the  effect  of  relative  and  ebaoluta  change  will  arise  renaetsdlw 

PM“>  U  “  b'li,v,d  th“  -ho-ld  b.  thoroughly 

...  r.C4?J,ij*1iS^fh0phySlc*1  theory  (*ee  f°r  example  Thurstons,  1927; 
and  Guilford  i’M)  at.te.  that  the  accuracy  with  which  change  in  •  * 

stimulus  can  be  detected  Is  a  function  of  the  relative  change  in  the 

T*1*®  la»  the  ▼•!««  of  the  stimulus  must  be  changed  by  some 
onstant  fraction  of  its  original  value  before  change  will  be  detected. 
cMff  p#ychopbyafcal  "lew"  has  been  supported  using  a  wide  variety  of 
different  atimuli  and  sensory  modalities.  The  most  relevant  research  for 

£h2ethePa22o!  21  C°nducted  by  Po*’  et  al*  (1W9)  whose  results  showed 
JS?  %*?  of  the  "t’uares  on  •  to  be  changed  by  s  constant 

d2-2  -  (!’1  pe5cenJ)  of  ita  original  value  in  order  for  subjects  to 
222  change  ln  alEe  fifty  Percent  of  the  time  (the  fifty-percent 
difference") . *8  *"  arbitrarlly  aelected  definition  of  a  "juat  noticeable 

"M-eJiIi222?dU2rUaed  2  th»  F°X  exPerlment,  and  others  like  it,  was  the 
-  22  2  P  ir*d  CoBpari8onB  in  wblch  the  subject  is  successively  shown 
a  standard  and  a  comparison  stimulus  and  asked  to  judged  whether  the  two 
appeared  different.  It  should  be  noted  that  because  oftSetJL  2te2al 
separating  the  two  stimulus  presentations,  the  task  necessarily  involves 
the  memory  capacity  of  the  observer— a  critical  characteristic  of  the 
procedure.  In  the  truest  sense  of  the  word  this  procedure  requires  the 
observer  to  judge  whether  or  not  a  change  has  occurred  rather  than  to 
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detect  chase*  as  la  usually  implied.  The  point  being  trade  here  is  that 
th*  above-mentioned  psychophysical  "law"  should  be  generalized  to  only 
Chat  portion  of  a  pilot's  task  that  calls  Upon  the  sane  type  abilities 
that  are  tapped  by  the  Method  of  Faired  Comparisons,  viz.,  tasks  in 
which  a  pilot  la  required  to  conpare  the  current  value  of  a  stimulus 
with  his  neaory  of  a  "standard"  stimulus  value. 

Consideration  shows  that  pilots  are  indeed  confronted  with  analogous 
tiihs  When  controlling  an  aircraft.  Any  time  a  pilot  is  required  to 
Judge  the  abaolut*  value  of  one  of  the  flight  parameters  from  the  VCAD, 
he  Is  required  to  utilize  his  memory  capacity  in  a  fashion  analogous  to 
that  described  above.  In  making  absolute  judgments,  the  pilot  is  trying 
to  assign  a  numerical  value  to  one  or  more  of  the  flight  parameters  using 
— hhijNjhe  VCAD  as  reference.  Assume,  for  the  sake  of  Illustration,  that 
a  pilot  deelrea  to  level  his  aircraft  at  one-thousand  feet  altitude. 

Inch  a  teak  require*  the  pilot  to  continuously  compare  his  present  die— 
play  configuration  with  hi*  memory  of  what  the  display  should  look  like 
at  one-thousand  feat  altitude. 

Could  the  pilot  perform  such  a  teek  more  accurately  on  a  larger 
display?  It  has  baen  shown  that  tha  ability  to  judge  whether  a  current 
attetlua  la  different  from  a  recalled  standard  is  a  function  of  the 
relative  difference  between  th*  two.  It  haa  also  baen  shown  that  rela¬ 
tive  change  in  sis*  per  altitude  increment  is  the  same  for  ell  size 
dieplays.  It  therefore  seams  reasonable  to  assume  that  those  tasks 
Involving  absolute  judgments  of  flight  parameters,  such  as  judging  altitude 
from  the  aiae  of  ground  texture,  would  be  made  with  about  the  same  degree 
of  accuracy  regardless  of  the  size  of  display  being  utilized. 

There  are,  however,  teaks  which  a  pilot  must  perform  other  than  those 
involving  absolute  judgments  of  flight  parameters.  For  example,  pilots 
it*  frequently  concerned  with  maintaining  a  given  flight  orientation  over 
an  extended  period  of  time.  Such  *  task  requires  that  the  pilot  continu¬ 
ously  monitor  the  VCAD  in  an  attempt  to  detect  and  null  a  change  in  one 
or  more  of  the  flight  parameters.  Obviously  the  ability  to  detect  change 
la  a  function  of  such  variables  as  the  rate  at  which  the  change  takes 
piece  and  pilot  vigilance  aa  well  as  the  magnitude  of  the  change,  but  It 
ia  only  the  latter  variable  thet  is  of  interest  hsre.  Specifically,  we 
ere  concerned  with  whether  detection  of  change  under  conditions  of  con¬ 
tinuous  viewing  is  a  function  of  relative  or  of  absolute  change  in  the 
stimulus. 

Whereas  judgment  of  a  change  (ea  previously  defined)  is  dependent  upon 
memory  capacity,  detection  of  a  change  would  appear  to  be  more  a  function 
of  perceptual  capacity  or,  more  precisely,  visual  acuity.  Although  no 
research  evidence  has  been  discovered  which  relates  detection  of  size 
changes  with  magnitude  of  the  change,  it  is  known  that  the  retina  is  quite 
sensitive  to  changes  in  position.  If  detection  of  a  change  in  the  size  of 
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cbj  !■  luuugnc  or  as  detecting  a  change  In  the  position  of  one  or 
more  of  Its  sides,  it  seems  intuitively  obvious  that  the  initial  else  of 
th«  object  being  viewed  would  have  little  effect  on  detection  ability  eo 
lo;.j-  as  at  least  one  of  the  sides  fell  within  the  observer’s  field  of  view. 
Thus,  the  most  feasible  guess  is  that  one  or  more  of  the  edges  of  an 
object  mu.it  traverse  some  constant  linear  distance  in  order  for  a  change 
in  size  to  be  detected— regardless  of  the  Initial  aisa  of  the  object  being 
viewed. 

Considering  that  the  absolute  change  in  the  size  of  ground  texture 
elements  resulting  from  a  given  Increment  in  altitude  la  greater  for 
larger  displays  and  given  the  assumption  that  the  size  of  the  threahold 
for  change  detection  la  some  constant  linear  value,  it  follows  that  S 
just  noticsable  change  in  size  would  represent  s  smaller  change  in  alti¬ 
tude  for  larger  displays.  Thus,  the  ability  to  detect  changes  in  altitude 
based  upon  size  of  ground  texture  elements  should  improve  as  display  sis* 
is  increased. 

In  an  attempt  to  further  clarify  this  rather  difficult  section,  the 
following  points  are  reiterated: 

(a)  The  else  of  the  ground  texture  elements  is  inversely  proportional 
to  altitude  end  thus  serves  as  one  possible  cue  to  altitude  and  altitude 
change. 

(b)  Holding  altitude  constant,  the  size  of  the  ground  texture  element* 
is  directly  proportional  to  the  size  of  display  being  utilised. 

(c)  The  relative  change  in  aize  of  the  ground  texture  elements  result¬ 
ing  from  a  given  increment  in  altitude  la  the  same  for  all  size  display*. 

(d)  The  absolute  change  In  aize  of  the  ground  texture  elements 
resulting  from  a  given  increment  in  altitude  la  linearly  related  to  dis¬ 
play  size. 

(a)  It  la  predicted  that  the  ability  to  make  absolute  judgment*  of 
altitude,  based  upon  the  cue  of  ground  texture  size,  is  independent  of 
display  size. 

(f)  It  is  predicted  that  the  ability  to  detect  changes  in  altitude 
based  upon  aize  of  ground  texture  elements  should  improve  as  display  size 
is  increased. 

Position  of  Texture  Breakpoints 

Texture  breakpoints  are  discussed  in  detail  in  the  "apparatus"  section 
of  this  paper  and  the  reader  unfamiliar  with  this  feature  of  the  VC AD  Is 
strongly  advised  to  refer  to  this  section  before  proceeding  further.  The 
content  of  thin  discussion,  however,  is  briefly  summarized  below. 
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Tin  gtuuuu  pi«u«  iraluie  la  compuaed  of  a  hierarchy  of  four  Basted 
orders  of  texture  elements.  Whereas  the  texture  elements  within  any 
given  order  are  ell  of  the  seme  else  end  shape,  the  element  site  and 
shape  differs  considerably  from  order  to  order.  The  unique  shapes  of 
the  texture  elements  within  each  of  the  four  orders  in  the  hierarchy  are 
_  ghown  in  figure  9.  The  dimensions  of  the  texture  elements  increase  by  a 
factor  of  eight  at  each  step  up  the  hierarchy — with  the  result  thst  the 
-  fourth  ordor  elements  ere  512  times  as  large  as  first  order  elements. 

The  CADG  is  constructed  such  thst  a  texture  element  within  a  given  order 
is  not  defined  (not  displayed)  when  the  distance  from  the  aircraft  to 
that  element  exceedB  some  preestablished  distance.  Thus,  for  example, 
first  order  texture  elements  may  be  seen  to  extend  up  to  500  yards  into 
...  the  distance.  However,  at  thie  point  on  che  earth  plane,  these  elements 
abruptly  terminate  and  only  second  and  higher  order  elements  can  be  seen 
at  distances  beyond  500  yards.  This  line  of  demarcation  between  orders 
of  texture  le  what  is  referred  to  as  a  breakpoint.  The  first,  second, 
and  third  orders  of  taxtura  have  breakpoints  but  the  fourth  order  texture 
extends  to  Infinity. 

Although  not  a  deliberately  designed  visual  cue,  these  breakpoints 
hays  been  found  to  provide  powerful  information  for  judging  altitude  and, 
under  certain  limited  condition*,  pitch.  Because  the  breakpoints  always 
"  occur  at  a  fixed  slant  range,  the  breakpoints  move  toward  the  bottom  of 
the  display  aa  altitude  la  increased,  and  toward  the  horizon  line  when 
altitude  is  decreased.  When  altitude  is  held  constant,  the  breakpoint 
maintains  e  constant  poisition  relative  to  the  horizon  line  regardless  of 
the  orientation  of  the  aircraft.  Results  to  date  have  shown  the  break¬ 
points  to  be  a  powerful  and  frequently  used  altitude  cue. 

Having  defined  the  manner  in  vhlch  breakpoints  serve  as  cues,  atten¬ 
tion  can  be  returned  to  the  question  of  primary  concern ,  viz . ,  whether 
display  else  would  be  expected  to  affect  the  powerfulness  of  the  texture 
breakpoint  cue.  It  wee  mentioned  in  the  previous  section  that  if  display 
Viewing  angle  is  held  constant  while  display  size  is  varied,  the  linear 
else  of  elements  appearing  on  the  display  varies  in  direct  proportion  to 
display  size.  Similarly,  it  can  be  shown  that  the  absolute  magnitude  of 
the  change  in  breakpoint  position  which  results  from  a  given  Increment  of 
altitude  is  proportionately  greater  for  larger  displays,  whereas,  relative 
change  remains  the  same  for  all  alee  displays.  If  an  increment  in  altitude 
is  sufficient  to  move  the  breakpoint  position  by  a  distance  of  one  inch 
on  the  face  of  e  5-inch  display,  the  same  increment  in  altitude  would  move 
the  position  of  the  breakpoint  the  same  relative  amount— two  inches  on  a 
10- inch  display. 

It  should  be  noted  that  the  nature  of  the  relationship  between  amount 
of  breakpoint  change  per  Increment  In  altitude  and  display  alze  is  precisely 
the  same  as  that  described  for  alee  of  ground  texture.  For  this  reason, 
the  predicted  effects  of  display  size  on  the  accuracy  of  altitude  judgments 
based  upon  breakpoint  position  ere  the  same  as  those  presented  in  the 
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previous  section.  Specifically,  it  is  predicted  that  (a)  the  accuracy 
of  absolute  judgments  of  altitude  based  upon  the  breakpoint  cue  should  be 
unaffected  by  display  size  and  (b)  the  ability  to  detect  altitude  chaagaa 
from  the  breakpoint  cue  should  improve  as  display  size  Increases. 

Inclination  of  Horizon  Line  and  Perspective  Lines 

The  most  familiar  cue  for  roll  angle  la  the  degree  of  Inclination  of 
the  horizon  line.  However,  it  should  bo  realised  that  roll  angle  infor¬ 
mation  is  also  provided  on  the  VCAD  by  the  degree  of  inclination  of  tne 
perspective  lines  formed  by  the  ground  texture  elements  and  by  those 
formed  by  the  sky  texture  elements.  Thus,  on  observer  con  learn  to  aaeo- 
clate  roll  angle  value  with  inclination  of  perspective  lines  in  the  seme 
way  that  he  establishes  such  associations  with  the  horizon  lint. 

Modifying  display  size  has  no  affect  on  tha  angular  inclination  of 
the  horizon  line  and  perspective  lines  for  there  is  always  direct  cor¬ 
respondence  with  real  world  inclination,  regardless  of  the  size  of  display 
being  used.  The  sole  effect  of  modifying  display  size — so  far  as  roll 
angle  cues  are  concerned — Is  to  proportionately  modify  the  length  of  the 
horizon  line  end  perspective  lines.  This  fact  is  clearly  illustrated  in 
figure  1  which  shows  identical  inclinations  on  two  different  size  dis¬ 
plays.  In  speculating  as  to  whether  judgments  of  the  inclination  of  a 
line  would  be  effected  by  the  length  of  the  line  being  judged,  one  point 
becomes  Immediately  obvious.  Increasing  the  length  of  e  line  rotating 
about  a  common  point  Increases  the  linear  excursion  through  which  the 
end  of  this  line  travels  for  a  given  angular  change;  therefore,  if  subjects 
attend  to  that  portion  of  the  horizon  line  furthest  from  the  central  axis, 
and  preliminary  evidence  suggests  that  they  do,  then  larger  displays  may 
provide  a  more  sensitive  index  of  change  in  roll  angle. 

Before  any  specific  predictions  can  be  set  forth,  it  is  necessary  to 
carefully  define  the  nature  of  the  relationship  between  linear  movement 
of  the  tip  of  the  horizon  line  and  display  size  (this  discussion  is 
equally  valid  for  perspective  lines).  This  relationship  is  mads  somewhat 
more  complicated  by  the  use  of  rectangular  displays.  Referance  to  figure  1 
will  show  that  the  length  of  the  horizon  line  is  affected  not  only  by  dis¬ 
play  size  but  also  changes  as  s  function  of  the  degree  of  horizon  line 
inclination  (d).  As  inclination  is  increased  from  0  to  90  degrees,  the 
length  of  the  horizon  line  increases  to  a  maximum  at  39  degrees — the  point 
at  which  the  horizon  line  intersects  with  the  corner  of  the  standard,  rec¬ 
tangularly  shaped  raster-scan  display — then  decreases  to  a  minimum  at  90 
degrees.  It  should  also  be  noted  that  the  horizon  line  displacement  is 
in  the  vertical  plane  when  the  absolute  value  of  a  is  less  than  39  degrees 
and  in  the  horizontal  plane  when  a  is  greater  than  39  degrees.  Thus,  s 
function  which  adequately  expresses  the  relationship  between  linear  dis¬ 
placement  of  the  horizon  line  and  display  size  must  take  into  consideration 
display  size,  the  angle  of  inclination,  the  amount  of  change  in  inclination. 
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Figure  1.  Illustration  of  the  Effect  of  Display  Size  on  tKo  Amount  of 
Excursion  Through  Which  flio  Ends  of  the  Horizon  Lino  Travel  as  o 


and  whether  the  displacement  occurs  la  the  vertical  or  horisoatal  dimension 
of  the  display.  The  following  two  equations  were  derived  in  accordance 
with  these  requirements: 


A  Dv  * 

2 

rv  sec 

a 

,  for: 

0  <  a  >  39* 

(3) 

ctn  A  a 

-  tan  a 

ADh  - 

2 

rh  «c 

a 

,  for: 

39* <  a  >90* 

(4) 

ctn  ^ a 

+  ctn  a 

Equation  3  defines  displacement  of  the  horiaon  line  in  the  vertical 
dimension  and  is  to  be  used  when  the  absolute  value  of  a  is  less  than  39 
degrees.  Equation  4  defines  displacement  in  the  horltontel  dimension 
and  is  to  be  used  when  the  absolute  valus  of  a is  betwean  39  and  90  dagreaa. 
These  equations  express  displacement  es  a  function  of  display  slat  (r), 
inclination  (a),  and  increment  in  inclination  it <9.  These  quantities 
are  defined  graphically  in  figure  2. 

The  equations  clearly  illustrate  that  the  excuralon  through  which 
the  tip  of  the  horizon  line  travels  ( &  D)  as  a  result  of  a  given  increment 
in  inclination  is  a  linear  function  of  display  alsa.  Although  lass 
obvious,  it  can  also  be  shown  that  whan  all  quantities  era  held  constant, 

A  D  approaches  a  maximum  as  a  approaches  39  degrees. 

It  should  be  clear  that  whan  a  approaches  39  degrees  snd/or  when 
display  else  is  Increased  a  given  linear  excursion  of  the  horizon  line 
along  the  edge  of  the  display  represents  a  smeller  angular  change. 

Following  the  rationale  presented  earlier,  it  la  predicted  that  the 
ability  to  detect  change  in  roll  angle  would  increase  aa  a  function  of 
display  size.  Furthermore,  for  a  given  size  display,  it  la  predicted 
that  ability  to  detect  change  would  increase  ae  roll  angle  approaches 
39  degrees.  Because  relative  change  ia  independent  of  display  size,  It 
is  predicted  display  size  would  have  no  effect  on  the  accuracy  with  which 
absolute  judgment*  of  roll  angle  could  be  made. 

Angular  Velocity  of  Ground  Texture  Elements 

In  a  contact  flight  situation  the  angular  rate  at  which  a  point  on 
the  ground  sweeps  beneath  the  aircraft  1b  a  function  of:  (a)  the  line  of 
Bight  to  the  ground  point,  (b)  the  aircraft  altitude,  and  (c)  aircraft 
speed.  Therefore,  the  angular  velocity  of  elements  on  the  ground  plane 
serves  as  a  prospective  cue  for  judging  altitude  and/or  speed.  The 
relationship  between  the  angular  velocity  of  any  point  on  the  ground  and 
the  altitude  and  speed  of  the  aircraft  is  expressed  by  the  following 
function  (for  a  contact  flight  situation) : 
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Where :  u  •  angular  velocity  at  eye  of  observer 
V  ®  ground  plane  velocity 

a  •  lookdown  angle  measured  from  longitudinal  axis  of  aircraft 

6  ■  lateral  look  angle  measured  from  longitudinal  axis  of  aircraft 
n  »  altitude 


It  ia  apparent  from  equation  (5)  that  the  angular  velocity  of  a 
given  point  on  the  ground  is  directly  proportional  to  ground  plane  velocity 
and  Inversely  proportional  to  the  altitude.  The  stimulus  configuration 
presented  on  the  VCAD  is  directly  analogous  to  the  stimulus  configuration 
obtained  in  contact  flight  If  and  only  if  display  size,  display  viewing 
angle,  and  viewing  distance  (distance  from  eye  of  observer  to  csntsr  of 
display)  are  such  as  to  produce  a  one-to-one  correspondence  with  the 
real  world.  In  order  to  define  the  stimulus  configuration  for  those 
situations  in  which  the  display  does  not  correspond  with  the  real  world, 
the  following  expression  was  derived.  The  terms  in  aquation  (6)  are  also 
defined  graphically  in  figure  2. 


Vad  ctn  (j) 

h  [  a2  ctn2  y  +  d2  ctn2 


(6) 


Where :  u< 
V 
a 
d 
a 
h 

y 


angular  velocity  at  eye  of  observer  (In  radians) 

ground  plane  velocity 

viewing  distance  (eye  to  display) 

one-half  display  height 

display  viewing  angle 

altitude 

lookdown  angle  ■  8  +  0  Where:  3  -  positive  angle  down  from 

horizon  to  line  of  sight 
to  ground  point 

9  «  negative  angle  down  from 
horizon  to  center  line 
of  display.* 


The  persisting  theme  throughout  this  section  has  been  the  Illustration 
of  the  relationship  between  the  powerfulness  of  a  displayed  cue  and  the 
size  of  display  being  utilized.  Unfortunately  the  relationship  between 
angular  velocity  and  display  size,  which  is  the  relationship  of  interest 
here,  is  not  intuitively  obvious  from  equation  6.  In  order  to  clarify 
this  relationship,  the  angular  velocity  of  a  point  on  the  ground  plane 
has  been  plotted  as  a  function  of  display  size  for  two  altitudes  and  two 
bp> eds  (see  figure  3).  Viewing  distance,  display  viewing  angle,  and 


When  pitch  angle  is  zero,  then  9  ■  0  and  y  •  6.  The  illustrations  in 
figure  2  were  drawn  with  a  zero  pitch  angle;  therefore,  since  Y  ■  8  only 
Y  is  shown. 
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Display  Size  (2d)  in  Inches 

Plg«t«  1.  Aapulat  Valaclty  •!  Lin*  af  Slpht  «•  •  Maying  Faint  an  *Ka  Dliplay  aa  a  Punttlon  of 
Ditplay  ilia,  AltlloAa,  on4  Actual  Ground  Plana  Valoclty. 


lookdown  angle  were  held  constant  at  26ninches,  90-degrees,  and  40- 
degrees  respectively. 

Although  not  the  relationship  of  primary  interest  it  should  be  noted 
in  figure  3  that  angular  velocity  is  directly  proportional  to  both  dis¬ 
play  alee  and  horizontal  velocity  but  inversely  related  to  altitude. 
Furthermore,  these  relationships  are  very  nearly  linear.  Of  aore 
immediate  interest  is  the  size  of  the  increment  in  angular  velocity 
that  results  from  an  increment  in  horizontal  velocity  or  from  a 
decrement  In  altitude,  remembering  that  it  is  this  increment  that  is  the 
yardstick  by  which  changes  in  speed  and  altitude  must  be  judged. 

First  examine,  for  each  display  size,  the  increment  In  angular 
velocity  that  results  from  a  decrement  in  altitude  of  500  feet.  This 
Increment  ia  represented  by  the  vertical  distance  between  the  two  solid 
lines  (V  »  360  kts)  and  between  the  two  dashed  lines  (V  ■  375  kts).  The 
fact  that  these  curves  systematically  diverge  as  display  size  ia 
increased  clearly  illustrates  that  the  magnitude  of  the  change  (decre¬ 
ment)  in  angular  velocity  la  greater  for  larger  displays.  It  would 
therefore  appear  that  a  given  altitude  change  would  be  aore  likely  to 
be  detected  on  a  larger  display. 

The  increment  in  angular  velocity  resulting  from  a  75  kt/hr  increment 
in  horizontal  velocity  is  represented  by  the  vertical  separation  between 
the  pairs  of  curves  coded  with  the  same  symbol.  Once  again  it  is  seen 
that  the  curves  diverge  aa  display  size  increases— showing  that  a  given 
Increment  in  horizontal  velocity  results  in  a  larger  increment  in  angular 
velocity  when  a  larger  display  ia  used.  The  conclusion  is  similar  to  that 
presented  above;  viz.,  speed  changes  should  be  more  accurately  detected 
on  larger  displays. 

Angle  of  Convergence  of  Perspective  Lines 

The  ground  plane  may  be  thought  of  as  a  matrix  of  essentially  infinite 
extent.  What  haa  been  referred  to  here-to-fore  aa  a  ground  texture  ele¬ 
ment  resides  within  each  cell  of  the  matrix,  giving  the  ground  plane  the 
appearance  of  a  completely  symmetrical  series  of  rows  and  columns  of 
texture  elements  on  a  homogeneous  background.  Unless  pitch  angle  equals 
+90  degrees,  the  columns  of  texture  elements  form  perspective  lines  which 
converge  at  the  horizon.  At  very  high  altitudes  these  perspective  lines 
appear  very  nearly  parallel,  whereas  at  very  low  altitudes  the  angle  of 
convergence  approaches  180  degrees.  The  systematic  change  in  degree  of 
convergence  that  results  from  altitude  change  provides  for  the  realistic, 
three-dimensional  appearance  of  the  display  and  also  provides  a  powerful 
cue  to  altitude.  A  quantitative  association  between  degrees  of  convergence 
of  perspective  lines  and  altitude  can  be  established  in  one  of  three  ways. 
These  are  illustrated  in  figure  4  which  shows  the  manner  in  which  a  set 
of  perspective  lines  change  as  a  result  of  an  increment  In  altitude. 

These  changes  are  Illustrated  for  two  different  size  displays,  one  super¬ 
imposed  on  the  other.  The  solid  lines  represent  the  original  position  of 
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the  perspective  line*  and  the  dashed  lines  represent  the  position  after 
an  increment  in  altitude  has  been  introduced. 

The  observer  can  learn  to  associate  altitude  wltht  the  angle  formed 
by  two  perspective  lines  (see  angle  a  in  figure  4),  the  angle  formed  by 
a  perspective  line  and  the  horison  line  (see  angle  6  in  figure  4),  or 
the  point  at  which  a  perspective  line  Intersects  the  edge  of  the  screen 
(see  point  P  in  figure  4) .  All  of  these  quantities  are  sensitive  to 
altitude  change  and,  with  training,  an  observer  can  learn  to  associate 
a  given  value  or  change  In  value  with  a  given  altitude  or  altitude 
change . 

The  amount  of  change  in  angle  a  and  6  per  increment  in  altitude 
is  the  same  regardless  of  the  else  of  display  being  used.  However,  the 
linear  excursion  through  which  a  perspactlve  line  travels  as  a  function 
of  an  increment  in  altitude  is  grester  for  larger  displays.  The  dif¬ 
ferences  in  the  length  of  lines  PP'  and  QQ*  illustrate  the  Increase  in 
linear  excursion  obtained  on  a  larger  display.  Therefore,  if  the 
observer  chooses  to  associate  the  difference  between  angles  a  and  o' 
or  between  0  and  8'  with  altitude  change.  It  Is  predicted  that  display 
size  would  have  no  effect  on  judgment  accuracy.  But  If  the  observer 
references  the  point  at  which  s  perspective  line  Intersects  the  edge  of 
the  screen  and  associates  change  In  position  of  this  point  with  change 
in  altitude,  it  would  be  predicted  Chat  larger  displays  would  facilitate 
altitude  judgment  accuracy. 

Position  of  Horizon  Line  in  Vertical  Plane 

The  position  of  the  real  world  horizon  line  is  the  most  direct  and 
familiar  Indicant  of  pitch  angle  In  contact  flight.  A  15-degree  change 
in  the  position  of  the  horizon  line  (in  terms  of  visual  angle  at  the  eye) 
indicates  a  15-degree  change  In  pitch  angle.  The  VGAD  horizon  line  is 
also  an  indicant  of  pitch  angle  but  the  amount  of  position  change  per 
Increment  In  pitch  angle  may  or  may  not  correspond  to  changes  in  the  real 
world  horizon  line.  The  amount  of  change  in  position  of  the  displayed 
horizon  line  is  a  function  of  not  only  pitch  angle  but  display  size  and 
display  viewing  angle  as  well. 

The  relationship  among  these  three  variables  is  illustrated  in  fig¬ 
ure  5.  The  larger  line  drawings  are  twice  the  size  of  the  smaller.  The 
solid  lines  represent  the  position  of  the  horizon  line  and  a  set  of 
perspective  lines  at  zero  pitch  angle,  whereas,  the  dashed  lines  repre¬ 
sent  their  position  after  a  15-degree  increment  in  pitch. 

The  set  of  drawings  marked  (a)  shows  the  nature  of  the  stimulus  con¬ 
figuration  when  the  display  viewing  angle  is  manipulated  such  as  to 
produce  a  one-to-one  real  world  correspondence  on  both  size .displays. 

The  equality  of  lines  AB  and  A’B'  shows  that  the  amount  of  horizon  line 
displacement  per  pitch  increment  is  the  same  for  both  displays.  When 
display  viewing  angle  is  held  constant  as  display  size  is  varied— as 
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(a)  If*  Pitch  ImrMMnf  Whan  ltd  Waal  WarW  Cerretpondencc  It  Molntolnod. 


10’ 


(b)  19°  Pitch  Increment  When  90*-Dleplay  Viewing  Angle  It  Maintained. 

Figure  5.  Effect  cf  Display  Site  and  Display  Viewing  Angle  on  the  Amount  of  Dlipleeement  of  the 
Horlton  Lina  Resulting  Pram  a  19*  Increment  In  Pitch. 
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»iiuwti  in  the  set  ot  drawings  marked  (b)— -the  amount  of  horizon  displace¬ 
ment  per  pitch  increment  increases  as  a  function  of  display  else.  The 
large  display  is  twice  as  large  as  the  smaller,  thus  the  amount  of  horl- 
son  displacement  la  twice  as  great  on  the  larger  display;  l.e.,  CD  ■  2C'D' . 

It  can  thus  be  seen  that  larger  displays  provide  a  more  sensitive 
index  of  pitch  angle  if  display  viewing  angle  is  held  constant  but 
that  no  such  advantage  exists  if  a  one-to-one  correspondence  with  the 
real  world  is  maintained  across  all  slae  displays.  Assuming  display 
viewing  angle  is  held  constant,  it  la  predicted  that  increasing  dis¬ 
play  size  would  facilitate  detection  of  pitch  changes. 

Shape  of  Ground  and  Skv  Texture  Elements 

When  positive  or  negative  pitch  angle  exceeds  one-half  tha  display 
viewing  angle,  the  horlson  line  disappears  from  the  display's  field  of 
view  and  is  no  longer  available  as  a  pitch  reference.  In  this  situation 
the  only  stable  cue  for  pitch  angle — other  than  the  "Zenith  Marker" 
which  will  be  discussed  later— that  Is  independent  of  the  other  flight 
parameters  la  the  shape  of  the  ground  and  sky  texture  elements.  It  Is 
only  when  pitch  Is  equal  to  positive  or  negative  90  degrees  that  the 
"retinal  shape"  of  the  texture  elements  (the  shape  of  Image  falling  on 
the  retina)  is  the  same  as  the  "apparent  shape"  of  the  elements  (the 
perceived  shape  or  the  shape  the  elements  are  known  to  be).  At  all  other 
pitch  angles  a  perspective  view  of  the  texture  elements  is  obtained  such 
that  the  retinal  ahape  is  different  from  the  apparent  shape.  That  is, 
the  retinal  shape  of  square  objects  is  actually  trapezoidal  and  the 
retinal  shape  of  round  objects  is  ovoid.  Despite  the  phenomenon  of  shape 
constancy  (objects  are  perceived  as  being  the  same  shape  from  all  angles 
of  regard)  a  human  observer  la  quite  sensitive  to  discrepancies  between 
apparent  shape  and  retinal  shape.  It  is  this  difference  that  serves  as 
a  cue  to  pitch  angle. 

Although  no  evidence  is  available  to  suggest  whether  sensitivity  to 
this  discrepancy  is  depedent  upon  the  absolute  size  of  the  object  being 
judged,  It  seems  highly  doubtful  that  such  an  effect  would  be  obtained 
over  the  range  of  Interest  here.  It  is  therefore  predicted  that  display 
size  would  have  no  appreciable  affect  on  the  judged  discrepancy  between 
retinal  and  apparent  shape  of  texture  elements. 

Anale  of  Regard  of  Skv  and  Ground  Texture 

Sky  and  ground  texture  elements  maintain  a  fixed  orientation  on  the 
displayed  sky  and  ground  plane.  As  heading  is  changed,  these  elements 
are  viewed  from  a  correspondingly  different  angle  of  regard.  Ability  to 
judge  heading  angle  is  therefore  a  direct  function  of  the  observer's 
ability  to  judge  the  angle  from  which  an  element  is  being  viewed.  As  the 
size  of  elements  on  even  the  smallest  display  being  considered  is  well 
above  the  acuity  threshold,  and  since  the  ability  to  judge  angle  of 
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regard  would  appear  to  be  independent  of  the  site  of  object  being  viewed 
eo  long  aa  it  can  be  clearly  seen.  It  eeeas  doubtful  that  display  else 
would  significantly  affect  judgment  accuracy. 

9S3S2133L 

In  defining  the  display  configuration  in  terns  of  the  specific  dis¬ 
play  featurae  that  eerve  aa  prospective  cues  for  one  or  more  of  the  flight 
paraaMtere,  we  have  essentially  identified  a  number  of  "perceptual  yard¬ 
sticks"  by  which  the  current  value  of  each  of  the  flight  parameters  must 
be  judged.  Each  of  these  yardsticks  was  examined  analytically  in  an 
attest  to  predict  whether  the  sensitivity  of  the  yardstick  would  be 
•fleeted  by  changes  in  display  else.  The  focus  of  this  examination  was 
the  msount  of  change  in  the  display  feature  that  results  from  a  given 
change  in  the  associated  flight  parameter.  The  finding  for  the  majority 
of  the  display  features  examined  was  the  same,  vis.,  the  amount  of 
"absolute  change"  was  found  to  be  greater  for  larger  displays  whereas 
"fnlatlvn  change”  was  found  to  be  the  same  for  all  sirs  displays.  These 
findings  led  to  the  general  predictions  that  (a)  the  accuracy  with  which 
VHMrlcnl  values  could  he  associated  with  each  of  the  display  features 
(absolute  judgments)  would  bo  independent  of  display  slse  and  (b)  an 
observer's  ability  to  detect  changes  in  the  flight  parameters  would 
Improve  aa  display  slse  is  increased. 

Research  Objectives 

The  experiments  reported  here  were  directed  at  two  broad  questions, 
Vis.,  "Mbit  la  the  effect  of  display  slse  on  an  observer's  ability  to 
extract  flight  relevant  Information  from  the  VCAD?  and  With  what  degree 
of  accuracy  can  flight  relevant  information  be  extracted  from  the  VCAD?" 
Thus,  the  primary  independent  variable  of  interest  in  these  experiments 
Is  display  slse  and  the  dependent  variable  of  interest  is  decoding 
accuracy.  The  objectives  of  the  experiments,  stated  as  briefly  as  pos¬ 
sible,  is  to  quantitatively  define  the  relationship  between  the  inde¬ 
pendent  (display  slse)  and  dependent  (decoding  accuracy)  variable. 

These  objectives  ere  further  clarified  in  the  discussion  below. 

The  rationale  for  designing  experiments  to  define  relationships 
rather  than  to  simply  detect  statistically  reliable  effects  should  first 
be  clarified.  This  rationale  evolved  from  a  need  to  generalise  beyond 
the  specific  display  aisaa  utilised  in  thia  study.  It  was  reasoned  that 
if  display  site  did  prove  to  exert  a  significant  influence  on  decoding 
accuracy  it  would  be  desirable  to  know  what  else  display  would  prove 
optimum.  Realising  that  there  was  no  assurance  that  one  of  the  display 
sises  tested  would  be  the  optlaua  else,  it  become  apparent  that  the  experi¬ 
mental  data  collected  should  provide  for  the  prediction  of  the  optimum 
display  slse.  It  was  also  reasoned  that  cockpit  design  considerations 
might  conflict  with  the  utilisation  of  the  optimum  display  sise.  Obviously, 
an  intelligent  trade-off  between  design  efficiency/economy  and  decoding 
accuracy  can  be  made  only  if  one  la  aware  of  the  degree  to  which  decoding 
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nm.*-n*»y  is  being  sacrifice £  as  a  result.  uf  utilizing  a  non-optimum 
display  size.  The  above  needs  can  be  served  only  by  a  reliable  estlaate 
of  Che  relationship  between  display  site  and  decoding  accuracy  over  a 
broad  continuum  of  display  sizes.  A  final  advantage  of  this  approach 
is  that  knowledge  of  the  nature  of  the  relationship  between  two  vari¬ 
ables  often  leads  to  Important  insights  into  the  basic  perceptual 
process  involved — insights  which  do  not  frequently  evolve  from  the 
comparative  statistical  approach  that  is  traditionally  used  in  hypothe¬ 
sis  testing. 

The  process  of  Interest  during  these  initial  experiments  is  limited 
to  the  perceptual  process  Involved  in  extracting  information  about 
various  flight  parameters  from  the  VCAD.  This  account#  for  use  of  the 
term  "decoding  accuracy"  to  describe  the  independent  variable  rather 
than  a  term  such  as  flight  proficiency.  These  experiments  wars  designed 
to  measure  decoding  accuracy  as  Independently  as  possible  from  the 
other  processes  normally  required  in  an  actual  flight  situation  such  as 
information  integration,  decision  making,  response  encoding,  etc.  To 
accomplish  this  purpose,  task  loading  and  conplexlty  of  response  encoding 
were  deliberately  reduced  to  a  minimum.  Obviously  decoding  ability  under 
such  simplified  conditions  will  be  superior  to  that  expected  in  an  actual 
flight  situation,  but  this  approach  is  believed  necessary  for  two  reaaona. 
First,  if  it  is  found  that  the  VCAD  cannot  be  decoded  with  sufficient 
accuracy  under  these  simplified  conditions,  it  will  be  apparent  that  sons 
type  of  supplemental  information  will  be  necessary  In  order  to  meet  mini¬ 
mum  information  requirements  in  a  flight  situation.  Second,  if  it  la 
found  that  decoding  is  accomplished  with  sufficient  accuracy  under  sim¬ 
plified  conditions,  but  breaks  down  when  the  control  task  is  made  mors 
complex,  it  will  be  known  that  the  decoding  process  is  not  the  weak  link 
in  the  total  perceptual-motor  process  and  attention  can  be  directed  at 
other  processes. 

Two  types  of  decoding  are  investigated.  One  type  has  been  previously 
identified  as  that  of  making  absolute  judgments  and  is  essentially  a 
measure  of  how  well  an  individual  can  associate  real  world  numerical  values 
to  the  various  flight  parameters  using  only  the  basic  VCAD  as  reference. 

A  second  type  of  decoding  has  been  previously  identified  as  that  of 
detecting  change  and  is  a  measure  of  how  well  an  individual  can  detect  a 
change  In  the  real  world  value  of  the  various  flight  parameters — whether 
or  not  he  can  associate  a  numerical  value  with  this  change. 


GENERAL  METHODOLOGY 

The  experiments  discussed  in  this  report  have  a  great  many  features 
in  common  as  far  as  methodology  is  concerned.  In  order  to  avoid  undue 
redundancy  a  general  discussion  of  methodology  will  be  presented  which 
is  relevant  for  all  the  experiments.  Then,  additional  methodological 
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futures  which  are  specific  to  individual  experiment-*  util  He  discussed 

where  appropriate. 

m  if  ^  sm  Ai  ■  ■  ^ 

The  experiments  reported  herein  were  conducted  in  the  Human  Factors 
Engineering  Advanced  Displays/Controls  Evaluation  Laboratory.  This  labor¬ 
atory  was  dealgned  to  facilitate  the  conduct  of  a  wide  variety  of  research 
and  thus  conaiats  of  a  rather  large  number  of  interconnected  and  highly 
versatile  components.  Two  different  views  of  the  laboratory  are  shown  in 
figure  6.  A  detailed  description  of  each  of  the  components  comprising  the 
experimental  apparatus  would  be  prohibitively  lengthly  and  would  add  little 
to  the  present  discussion.  For  this  reason,  the  apparatus  has  been 
divided  into  three  functional  components  for  discussion. 

VSAP  generator 

The  VCAD  Generator  la  a  special  purpose  digital  computation  system 
that  accepts  position  and  attitude  data  from  an  aircraft  simulation 
system,  integrates  this  data  and  performs  the  computations  necessary  to 
synthesise  a  rapidly  updated,  analogous  representation  of  the  aircraft 
environment  as  it  would  appear  from  an  aircraft  cockpit.  This  one-of-a- 
kind  device  la  an  experimental  tool  which  was  developed  for  the  sole 
purpose  of  evaluating  ths  VCAD  concept.  Its  construction  la  such  that 
many  of  the  features  of  the  generated  display  can  be  conveniently  varied 
over  a  wide  range  of  value.  The  Important  features  of  the  VCAD  Generator 
are  discussed  below.  The  raadar  is  referred  to  volumes  A  and  B  of  the 
VCAD  instruction  manual  (General  Electric,  May  1966)  If  a  more  technical 
discussion  la  desired. 

Skv  and  Ground  Plane!  The  VCAD  Generator  defineB  both  a  sky 
plana  and  a  ground  plane  which  appear  on  the  display  as  planes  of  infinite 
extent.  The  ground  plane  la  computed  to  be  tangent  to  the  earth's  surface 
St  the  nadir  of  the  simulated  aircraft.  The  sky  plane  is  computed  to  be 
parallel  to  the  ground  plane  and  la  situated  at  a  fixed  altitude  above  the 
ground  plane.  Computationally,  the  eky  and  ground  planes  ere  composed  of 
am  infinite  number  of  square  matrices  situated  edj scent  to  one  another  in 
ayametrlcal  rows  and  columns.  Each  matrix,  in  turn,  consists  of  eight 
rows  and  columns  of  ''calls."  The  VCAD  Generator  le  designed  to  provide 
for  independent  on-off  control  of  the  64  cells  within  a  matrix,  but  does 
not  provide  for  independent  control  of  the  matrices  themselves.  That  is, 
although  the  on-off  atate  of  a  given  cell  may  be  arbitrarily  selected, 
this  same  atate  will  exist  in  the  corresponding  cell  of  every  matrix 
appearing  on  the  plane. 

The  above  design  characteristic  defines  both  the  capability  and 
limitation  for  producing  a  variety  of  texture  patterns  on  the  sky  and 
ground  planes.  A  homogeneous  surface  is  obtained  if  all  64  cells  are 
placed  in  the  same  state.  A  textured  surface  is  obtained  so  long  as  the 
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■tat*  of  one  or  more  cells  Is  different  from  those  remaining.  The 
variety  of  different  texture  patterns  that  can  be  produced  Is  equal  to 
the  mother  of  on-off  combinations  of  64  objects  taken  one  or  more  at  a 
time ■  It  should  be  kept  In  mind,  however ,  that  even  though  a  texture 
mas  composed  by  determining  the  state  of  each  of  the  cells  randomly,  the 
texture  of  the  plane  would  still  appear  symmetrical  due  to  the  repetition 
of  the  pattern  in  all  matrices  appearing  on  the  plane. 

Based  upon  the  parameters  which  define  the  momentary  position  and 
attitude  of  the  simulated  aircraft,  the  VCAD  performs  the  computations 
necessary  to  display  an  of  the  sky  and  ground  plane  as  they  would 

appear  from  a  similarly  situated  aircraft.  These  computations  are  based 
upou  "real-world"  geometric  and  perspective  ruleB  making  the  view  of  the 
sky  and  ground  planes  obtained  on  the  display  a  faithful  analrgy  of  real 
world  conditions.  (This  faithful  analogy  between  the  features  of  a 
synthetic  world  and  thpse  of  the  real  world  enable  an  observer  to  utilise 
those  perceptual  skills  developed  during  a  lifetime  of  everyday  experience 
and  represents  the  fundamental  theme  of  the  VCAD  concept.)  The  computa¬ 
tions  necessary  to  present  an  updated  view  of  the  sky  and  ground  plane 
occur  30  times  per  second.  Although  these  changes  occur  discretely,  the 
update  rate  la  sufficiently  rapid  to  produce  the  effect  of  continuous 
Change.  With  one  exception,  the  change  in  the  view  of  the  sky  and  ground 
planes  which  reaulta  from  a  change  in  one  or  more  of  the  flight  parameters 
follows  real  world  geometric  and  perspective  rules.  This  exception  is 
that  changes  in  the  sky  texture  elements  are  independent  of  changes  in 
both  velocity  and  altitude.  Elements  on  the  sky  plane  always  appear  to 
be  tha  same  distance  above  the  simulated  aircraft  regardless  of  altitude. 
Furthermore,  the  sky  texture  elements  do  not  appear  to  sweep  overhead 
as  one  would  expect;  rather,  their  position  is  fixed  with  respect  to  the 
aircraft  regardless  of  its  position  and  velocity.  Thus,  the  sky  plane 
can  be  said  to  reepond  to  rctetion  about  the  three  axes  of  the  aircraft 
but  does  not  respond  to  aircraft  translation. 

The  scaling  in  all  computations  is  determined  by  the  size  of  the  "cell"- 
the  baaic  element  of  both  the  sky  and  ground  planes.  Cell  size  is  variable 
end  can  ba  mad*  to  equal  4-,  8-,  16- ,  32-,  or  64-feet.  The  effect  of  cell 
else  upon  the  display  configuration  is  illustrated  in  figure  7.  The  result 
of  changing  cell  size  Is  obviously  to  change  the  size  of  the  ground  texture 
elements  on  the  ground  plane.  One  setting  may  produce  a  display  configur¬ 
ation  that  would  be  analogous  to  flying  over  terrain  dotted  with  houses. 
Another  setting  may  produce  a  view  analogous  to  flying  over  a  rural  area 
where  the  terrain  ia  divided  intr>  square-mile  segments. 

It  should  also  be  noted  that  the  aize  of  the  basic  texture  element  is 
also  affected  by  the  number  of  cells  used  to  construct  the  texture  element. 
This  aspect  is  illustrated  in  figure  8  which  illustrates  the  manner  in  which 
three  types  of  texture  elements  were  constructed  on  the  8x8  cell  matrices 
and  shows  their  respective  appearance  on  the  display.  Note,  for  example, 
that  the  size  of  the  basic  texture  element  in  the  right-hand  figure  appears 
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clearly  smaller  than  the  elements  In  the  remaining  tun  nmtt-amm.  This 
is  true  despite  the  fact  that  a  greater  number  of  cells  were  used  to 
construct  the  former. 

Several  other  features  associated  with  texture  patterns  are 
illustrated  in  figure  8.  The  right-hand  pattern  (which  was  constructed 
to  approximate  a  random  pattern)  Is  more  dense  and  less  symmetrical 
appearing  than  the  other  two  patterns.  The  location  of  perspective 
lines  (formed  by  the  texture  elements)  is  less  clear  in  the  right-hand 
pattern.  The  qualities  of  symmetry,  density,  and  clearness  of  perspec¬ 
tive  lines  appear  to  be  important  attributes  of  ground  texture  and 
warrant  experimental  investigation  in  the  future. 

Levels  of  Texture  and  Texture  Breakpoints!  Calculation  will 
show  that  texture  elements  small  enough  to  provide  useful  cues  at  low 
altitudes  appear  so  small  as  to  be  indistinguishable  at  vary  high  alti¬ 
tudes.  And,  conversely,  texture  elements  large  enough  to  be  seen  at 
high  altitudes  would  subtend  such  a  large  visual  angle  at  low  altitudes 
that  the  angular  extent  of  a  single  element  would  exceed  the  display 
field  of  view — with  the  effect  that  the  ground  plane  would  appear  as  an 
untextured  surface.  The  same  problem  exists  for  slant  range.  That  ia, 
small  elements  cannot  be  aeen  at  great  distances  and  large  elements, 
whose  size  is  suitable  for  great  distances,  exceed  the  display  field-of- 
view  when  the  viewing  distance  ia  small.  Thus,  providing  appropriate 
texture  cues  over  a  vide  range  of  altitudes  and  slant  ranges  is  a  problem 
that  required  special  consideration  in  the  design  of  the  VCAD. 

The  difficulty  was  overcome  by  constructing  the  ground  texture 
from  a  hierarchy  of  four  nested  texture  patterns.  The  basic  texture 
element  for  each  step  of  the  hierarchy  has  a  unique  shape  and,  at  each 
succeeding  step  up  the  hierarchy,  the  size  of  the  texture  element  Increases 
by  a  factor  of  eight.  The  first  order  texture  element  is  constructed 
from  an  8x8  matrix  of  cells.  The  second  order  texture  element  is  constucted 
from  a  64x64  matrix  of  cells  or,  stated  differently,  from  an  8x8  matrix 
of  first  order  matrices.  Similarly,  the  third  order  texture  element  la 
constructed  from  an  8x8  matrix  of  second  order  matrices.  Thus ,  a  fourth 
order  texture  element  is  512  times  as  large  as  a  similarly  shaped  first 
order  element.  The  drawings  in  figure  9  are  examples  of  unique  texture 
shapes  that  can  be  utilised  for  the  four  orders  of  texture.  Furthermore, 
these  drawings  illustrate  the  relative  size  of  the  elements  of  each  order 
of  texture. 

Additional  understanding  of  the  hierarchical  structure  of  texture  ele¬ 
ments  and  the  concept  of  "breakpoints"  can  be  obtained  by  referencing  the 
series  of  photos  shown  in  figure  10.  These  five  photos  illustrate  changes 
in  the  display  as  a  result  of  increasing  altitude  from  10  to  1000  feet — 
where  pitch  angle  and  roll  angle  are  held  at  zero  and  cell  size  is  main¬ 
tained  at  8  feet.  Note  that  only  the  first  order  texture  elements  ("l"s) 
can  be  seen  at  at.  altitude  of  10  feet.  As  altitude  is  increased  to  50 
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feet  intral  eh«na»»  nrt-t irt  fW«  angular  sir-  cf  the  "l"s  decreases,  the 

second  order  texture  ("L"e)  begins  to  emerge,  and  a  point  can  be  seen 
M  tba  distance  at  which  the  first  order  texture  abruptly  terminates. 

This  abrupt  line  of  demarcation  between  orders  of  texture  is  what  is 
referred  to  as  e  breakpoint.  Breakpoints  always  occur  at  a  constant  slant 
range  (for  a  given  cell  sise  and  display  viewing  angle)  regardless  of 
tile  orientation  of  the  aircraft.  The  designers  of  the  CADG  computed  the 
slant  range  at  which  the  texture  elements  of  a  given  order  could  no  longer 
bs  resolved  by  the  display  and  programmed  the  CADG  to  disregard  elements 
in  this  order  of  texture  when  the  Blent  range  to  these  elements  exceeded 
the  preasalgned  value.  This  design  feature  is  comparable  to  the  acuity 
threshold  of  the  human  eye,  except  that  the  CADG  is  not  susceptable  to 
the  variety  of  conditions  which  affect  the  eye's  acuity  threshold.  Only 
second  order  texture  elements  can  be  seen  beyond  the  first  breakpoint, 
though  the  second  order  texture  elements  are  embedded  in  the  first  order 
texture.  Actually,  ell  of  the  higher  orders  of  texture  are  embedded  in 
this  manner,  although  this  feet  Is  not  apparent  from  an  altitude  of  50 
feet. 


As  altitude  continues  to  Increase,  the  first  breakpoint  systematically 
approaches  the  bottom  edge  of  the  screen  until  at  1000  feet  this  break¬ 
point  can  no  longer  be  seen.  This  means  that  the  slant  range  to  the  near¬ 
est  ground  point  appearing  on  the  display  exceeds  the  slant  range  to  the 
first  braakpolnt.  If  the  aircraft  were  pitched  down  and  if  the  altitude 
did  not  axceed  the  slant  range  to  the  first  breakpoint,  the  first  break¬ 
point  would  reappear  on  the  display. 

At  1000-feet  altitude,  the  second  breakpoint  and  the  third  order  tex¬ 
ture  can  be  dearly  seen.  If  altitude  were  increased  still  further,  the 
fourth  order  texture  would  emerge  end  the  second  and  third  breakpoints 
would  disappear  in  the  same  manner  as  the  first  breakpoint. 

Display  Viewing  Angle:  Display  viewing  angle  has  been  discussed 
previously  end  wee  defined  graphically  In  figure  2  (see  angle  a).  It  is 
display  viewing  angle  that  determines  the  angular  extent  of  tna  model 
world  that  Is  projected  on  the  display  and  is  defined  quite  independently 
of  the  eye  of  the  observer.  It  should' again  be  emphasized  that  one-to-one 
correspondence  with  the  "real  world"  exlata  only  when  the  visual-angle 
subtended  by  the  display  is  the  same  as  the  display  viewing  angle. 

Zenith  Marker:  A  unique  8x8  cell  matrix  is  located  on  the  sky 
plane  at  the  Intersection  of  the  nadir-zenith  line  and  the  sky  plane.  This 
matrix  permits  the  Introduction  of  a  uniquely  shaped  symbol  at  this  point 
on  the  sky  plane  making  this  geographical  point  easily  distinguished.  This 
symbol,  hereafter  referred  to  as  the  Zenith  Marker,  is  always  located 
directly  above  the  simulated  aircraft  regardless  of  its  orientation  and 
provides  a  valuable  cue  to  pitch  when  positive  pitch  angle  is  so  large  that 
the  horizon  line  doea  not  fall  within  the  display  field  of  view. 
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the  form  of  symbols  can  be  added  to  the  basic  display  as  desired.  As 
only  one  of  these  symbols  were  utilised  in  the  present  experiments, 
they  deserve  only  brief  mention  here.  The  special  symbols  that  can 
presently  be  presented  on  the  display  Include:  (a)  a  flight-path  which 
can  be  presented  in  either  an  earth-stabilised  or  flight-director  mode, 

(b)  three-dimensional  building-shaped  objects  located  on  the  ground 
plane,  (c)  a  symbol  in  the  shape  of  a  cross  which  identifies  the  posi¬ 
tion  of  the  impact  point,  (d)  square-shaped  symbols  whose  position  on 
the  display  can  be  made  to  be  a  function  of  one  or  more  of  the  flight 
parameters,  (e)  a  fixed-scale  moving-pointer  cursor  which  can  be  made 
to  display  error  in  any  of  the  flight  parameters,  (f)  two  sets  of  four¬ 
digit  numerics  which  can  be  made  to  reflect  the  momentary  value  of  any 
two  flight  parameters,  (g)  a  uniquely  textured  ground  location  which 
maintains  a  fixed  geographical  position  on  the  ground  plane,  and  (h)  a 
runway  whose  length  and  directional  orientation  can  be  varied. 

CADG  Inputs;  The  inputs  accepted  by  the  CADG  include:  north 
rate,  east  rate,  altitude  rate,  heading  angle,  pitch  angle,  and  roll 
angle.  It  rhould  be  noted,  however,  that  roll  la  not  computed  by  the 
CADG  but  is  accomplished  by  rolling  the  yoke  on  the  neck  of  the  CRT. 

Flxed-Baae  Cockpit 

Experimental  subjects  were  housed  in  a  general  purpose  fixed-bane 
cockpit  that  was  designed  to  accommodate  a  variety  of  different  display/ 
control  configurations,  depending  upon  the  requirements  of  the  experiment. 
An  inside  and  outside  view  of  the  fixed-base  cockpit  Is  shown  in  figure  11. 
The  display  used  in  all  the  experiments  discussed  in  this  report  was  the 
"basic  VCAD,"  which  includes  the  textured  sky  and  ground  planes,  but  none 
of  the  special  symbols  previously  discussed.  Manipulation  of  display  size 
was  accomplished  through  changing  the  size  tube  on  which  the  display  vaa 
presented  while  holding  viewing  distance  constant  at  32  Inches.  Four 
different  tube  sizes  were  used.  Although  these  are  referred  to  in  this 
report  as  5-,  8-,  14- ,  and  17-inch  displays  (commercial  designation) 
their  actual  height  and  width  dimensions  are  as  shown  below.  Shown  in 
parenthesis  is  the  vertical  and  lateral  visual  angle  subtended  by  each 
of  the  four  tubes.  Unless  viewing  distance  is  the  same,  only  the  visual 
angle  dimensions  should  be  generalized  to  other  situations. 

Tube  Size  Height  Width 


5" 

3.4" 

(6®6') 

4.5" 

(7®  58’) 

8" 

5.4" 

(9*34’) 

7.0" 

(12®  30') 

14" 

9.1" 

(16*  16') 

11.9" 

(21®  4’) 

17" 

10.9" 

<19°  22') 

14.2" 

(25®  2') 
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A  standard  aircraft  joystick  located  a  convenient  distance  In  front 
of  the  subject  ana  m  alignment  with  the  mid-line  of  his  body,  was  the 
control  device  used  in  all  the  experiments.  Through  manipulation  of 
the  joystick,  the  subject  controlled  the  output  of  a  potentiometer 
which,  in  turn,  drove  the  value  of  the  flight  parameter  being  investi¬ 
gated.  The  joystick  served  as  a  rate  control  in  all  experiments;  l.e., 
the  rate  of  change  of  the  controlled  parameter  being  a  function  of  the 
amount  of  displacement  of  the  joystick  from  its  null  position. 

Control  of  roll  angle  was  accomplished  through  lateral  displacement 
of  the  joystick.  The  display/control  relationship  used  was  the  same  as 
that  in  an  aircraft;  for  example,  displacement  of  the  joystick  to  the 
right  of  the  null  position  caused  the  horizon  to  roll  toward  the  left. 
Longitudinal  displacement  of  the  joystick  controlled  either  altitude  or 
pitch,  depending  upon  which  parameter  was  being  investigated.  When  pitch 
judgments  were  being  investigated,  displacement  of  the  stick  forward  of  the 
null  position  caused  the  aircraft  to  pitch  down,  whereas,  displacement  in 
tlie  opposite  direction  caused  the  aircraft  to  pitch  up.  In  those  experi¬ 
ments  dealing  with  altitude  judgments,  a  forward  stick  displacement  caused 
altitude  to  decrease  and  a  backward  displacement  caused  altitude  to  increase. 
It  should  be  understood  that  only  one  parameter  was  under  the  S?s  control 
during  any  given  experiment. 

Performance  Measurement  System  (PMS) 

The  PMS  is  composed  of  (a)  an  Electronic  Associates,  Inc.  (EAI)  TR-48 
analog  computer  used  in  conjunction  with  an  EAI  general  purpose  Digital 
Expansion  System  (DES-30),  (b)  a  24-channel  Minneapolls-Honeywell  Visi- 
corder,  and  (c)  a  Clmron  Model  703  Data  System.  The  components  of  the 
PMS  are  functionally  connected  with  both  the  CADG  and  the  fixed-base 
cockpit  so  that  the  value  of  each  of  the  flight  parameters  as  well  as  stick 
output  can  be  continuously  monitored  by  the  analog  computer.  The  raw 
quantities  can  be  directly  read'out  on  the  digital  voltmeter  located  on  the 
TR-48  computer,  they  can  be  fed  to  the  Visicorder  and  read-out  in  the  form 
of  continuous  oscillographic  records,  and  (or)  they  can  be  fed  to  the  Clmron 
Data  System  which  can  sequentially  scan,  evaluate,  and  print-out  the  value 
of  up  to  100  inputs.  Typically,  however,  the  signals  were  processed  In 
some  way  before  being  read»out.  For  example,  error  scores  were  computed 
by  subtracting  the  actual  value  of  a  parameter  from  an  assigned  command 
value  (hereafter  referred  to  as  the  "standard").  The  majority  of  the  per¬ 
formance  measures  were  derived  by  submitting  the  error  output  to  various 
mathematical  manipulations.  In  the  case  of  discrete  judgments,  such  as 
setting  altitude  at  some  prescribed  value,  the  PMS  provided  a  discrete 
read-out  of  error,  and  various  computations  were  performed  on  off-line 
computers.  In  the  case  of  continuous  judgment  taskB,  such  as  maintaining 
one  of  the  parameters  at  a  constant  value  over  an  extended  period,  error 
wac  read-out  continuously  and  the  computations  performed  on-line  by  the 
TR-48  analog  computer.  The  various  performance  measures  obtained  are  dis¬ 
cussed  below  for  both  the  discrete  and  the  continuous  case. 
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pf1Tf"TirT>c*  Measures 


Awrttt  Absolute  Error  (AAE) 

Anrtgt  Absoluts  Error  for  the  continuous  and  the  discrete  case  is 
liven  in  equations  7  and  B,  respectively. 

t2 

t  f  /e(t)/dt  (7) 
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These  measures  are  particularly  useful  in  comparing  relative  performance 
under  various  experimental  conditions.  However ,  because  the  same  amount 
of  error  can  be  accumulated  in  a  variety  of  different  ways,  assuming  total 
equivalency  of  performance  on  the  basis  of  equivalency  of  AAE  scores  alone 
may  result  in  important  qualitative  differences  in  performance  being  over¬ 
looked. 

Root  Mean  Square  (RMS)  Error 

RMS  error  can  be  shown  to  be  the  standard  deviation  of  the  error  about 
the  designated  standard.  If  the  error  Is  normally  distributed  about  the 
standard i  that  is,  if  no  response  bias  exists,  one  can  expect  error  to  be 
within  one  standard  deviation  of  the  standard  68  percent  of  the  time. 

The  equations  for  RMS  error  for  the  continuous  and  the  discrete  case  are 
given  below  in  equations  9  and  10. 


i-1 


Average  Error  (AB) 

Equations  It  and  12  show,  for  both  the  continuous  and  discrete  case, 
thtt  AE  is  obtained  by  accumulating  error  witti  respect  to  the  sign  and 
represents  the  mean  of  the  error  distribution.  Thus,  AE  provides  .j  diiect 
index  of  performance  bias. 


e(t)dt 
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Standard  Deviation  about  Mean  of  Error  Distribution  (SD£) 


Whereab  RMS  is  an  index  of  the  variability  of  error  about  the 
assigned  or  "true"  standard,  SDg  can  be  thought  of  as  the  variability 
of  error  about  S/s  concept  of  memory  of  the  standard — which  may  or  may 
not  correspond  with  the  true  standard.  If  S/s  concept  of  the  standard 
does  correspond  with  the  true  standard  and  error  is  distributed  normally, 
AE  (bias)  will  be  zero  and  RMS  and  SDg  will  be  identical.  If  S/s  per¬ 
formance  is  biased,  RMS  would  necessarily  increase  in  size  yet  SDg  could 
remain  small.  Such  a  result  would  indicate  a  consistent  bias  in  S's 
concept  of  the  standard,  but  a  small  amount  of  variability  about  this 
"assumed"  standard.  A  large  RMS  score  coupled  with  a  similarly  large 
SDg  score  would  simply  indicate  highly  erratic  performance.  Thus,  SDg 
serves  primarily  as  a  diagnostic  tool. 


Time  History  Recordings 

Continuous  oscillographic  records  of  the  momentary  value  of  the 
flight  parameter  being  Investigated  and  momentary  error  ware  obtained. 

Only  selected  trials  were  recorded.  Because  quantitative  measures  obtained 
from  oscillographic  records  are  typically  Inaccurate  and  extremely  time 
consuming  to  obtain,  the  primary  purpose  of  these  recordings  was  to  provide 
a  qualitative  notion  of  response  strategies  and  to  provide  an  additional 
check  of  the  validity  of  the  analytical  measures  described  above. 

Analytic  Approach 

Customarily,  the  analytic  approach  is  discussed  in  the  "Results" 
section  of  a  research  report.  In  the  present  case,  however,  the  analytic 
approach  for  all  the  experiments  is  essentially  the  same;  and  devoting 
a  separate  section  to  their  discussion  avoidB  unnecessary  repetition. 

Also,  because  the  analytic  approach  that  was  developed  is  one  which  will 
be  unfamiliar  to  many  readers,  it  is  believed  necessary  to  both  describe 
the  approach  in  general  and  to  discuss  some  of  the  conditions  which 
necessitated  its  development. 
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Experimental  Designs 


The  experimental  designs  found  most  suitable  for  present  purposes  were 
Fractional  Replications  designs  using  repeated  measures.  The  principle 
advantage  of  these  designs  Is  that  large  savings  in  tine  are  realized 
by  not  having  to  obtain  data  for  all  possible  combinations  of  conditions — 
as  is  reqjlredwhen  using  Complete  Factorial  designs.  Fractional 
Repllcat  ’.one  designs  have  the  disadvantage  of  not  providing  estimates 
of  certain  third-  and  higher-order  interactions.  In  most  cases  these 
higher-order  interactions  were  judged  to  be  highly  unlikely  or  negligible 
In  size.  When  this  assumption  could  not  be  made  with  a  high  degree  of 
confidence.  Complete  Factorial  designs  were  used. 

The  use  of  repeated  meaaurea  permit  the  separation  of  subject  effects 
from  treatment  effects  thus  providing  a  more  precise  measure  of  treatment 
effects.  Also,  Repeated  Meaaurea  designs  permit  the  estimation  of  treatment 
affects  despite  the  presence  of  sequence  effects  such  as  learning  and 
fatigue— both  of  which  were  present  in  these  experiments. 

Polvnomlnal  Response  Surface  Model 

A  central  assumption  of  Analysis  of  Variance  models,  which  have 
traditionally  been  used  for  Fractional  Replications  designs  with  repeated 
measures,  is  that  the  shape  of  the  performance  curve  is  the  same  for  all 
subjects  and  all  conditions  (Winer,  1962).  This  assumption  is  seldom 
valid  for  psycholcgical  data  (see  Thorndike,  1949,  p  113)  and  was  certainly 
invalid  for  the  data  reported  here.  An  even  more  serious  shortcoming  of 
conventional  models  is  that  they  do  not  permit  generalization  beyond  the 
particular  conditions  investigated.  Either  of  these  shortcomings  would, 
in  Itself,  render  Analysis  of  Variance  models  unacceptable  for  present 
purposes. 

A  of  models  called  "Rouponse  Surface  Models"  were  found  to  lie 

compatible  with  our  research  objectives  and  yet  did  not  require  that  unrea¬ 
listic  assumptions  be  made  about  the  form  of  data.  These  models  serve  to 
define  continuous  relationships  between  values  of  the  independent  and 
dependent  variables.  Thus,  the  value  (or  "response")  of  the  dependent 
variable  can  be  calculated  for  any  combination  of  values  for  the  independent 
variables.  A  "surface"  can  be  generated  from  a  systematic  collection  of 
"responses" — hence,  the  name  response  surface. 

The  most  fruitful  type  of  Response  Surface  Models  have  used  poly¬ 
nomial  aeries  to  approximate  functions  and  are  called  "Polynomial  Response 
Surface  Modela"  (Cochran  &  Cox,  1957).  These  models  rely  on  the  fact  that 
many  differently  shaped  functions  can  be  closely  approximated  by  polynomial 
series.  Moreover,  the  mouels  can  be  fitted  through  the  use  of  well  estab¬ 
lished  regression  techniques.  To  illustrate  the  form  of  response  surface 
models,  an  example  of  a  second  order  (quadratic)  surface  involving  the 


independent  variables  X..  and  X..  and  the  dependent  variable  Y1  is  given 
below:  11 

Yi  -  eQ  +  SjX,2  +  02X1  +  83^X2  +  64X2  +  BjX22  +  e4  (14) 

Similar  equations  can  be  written  for  extensions  of  the  form  involving 
several  variables  and/or  high  order  (powered)  terms. 

Analytic  Procedure 

The  first  step  in  the  analytic  procedure  was  to  generate  a  popula¬ 
tion  of  prospective  predictor  variables;  the  most  obvious  candidate 
being  the  Independent  variable  of  primary  Interest— in  this  case,  display 
size.  Moreover,  any  other  independent  variable  that  was  experimentally 
controlled  and  which  is  likely  to  contribute  to  judgment  error  must  be 
included  as  a  prospective  predictor  variable,  whether  or  not  the  variable 
is  of  particular  Interest  in  the  study.  Examples  of  such  variables 
include  the  skill  of  the  Individual  S,  ("subject")  the  stage  in  learning 
or  amount  of  fatigue  ("sessions")  the  value  of  the  parameter  being  judged 
("standard"),  and  so  on.  Also,  powered  terms  such  as  (sessions)^  or 
(sessions)3,  and  interaction  terms  such  as  "sessions  x  subjects"  are 
prospective  predictors  and  must  therefore  be  included.  The  population 
of  prospective  predictor  variables  thus  derived  averaged  about  thirty 
for  the  various  experiments. 

This  population  of  predictor  variables  was  then  submitted  to  a 
Computerized  Stepwise  Multiple  Regressions  Analysis  (developed  by  Wherry, 
1966)  which  sequentially  evaluates  each  predictor  variable.  The  tech¬ 
nique  selects  terms  for  a  regression  equation  with  the  requirement  that 
each  term  selected  must  improve  the  "expected  fit"  of  the  model  to  the 
data.-1*  The  end  result  is  a  print-out  of  those  variables  found  to  contribute 
to  the  prediction  of  the  dependent  variable  and  their  associated  weighting 
constants,  the  composite  of  which  is  a  multi-variate  regression  equation. 

This  equation  is  a  highly  versatile  tool  and  provides  the  capability  of 
expressing  the  relationship  between  the  dependent  variable  and  independent 
variables  singly  or  in  any  desired  combination. 

The  equations  generated  for  the  various  experiments  were  in  turn,  used 
to  generate  predicted  values  of  the  dependent  variable  for  a  number  of 
values  of  the  independent  variable  over  the  range  of  interest.  When 
plotted  in  graphical  form,  these  data  clearly  illustrate  the  dependent/inde- 
pendent  variable  relationship,  if  such  a  relationship  were  indicated  by  the 
raw  data.  It  should  be  noted,  however,  that  in  only  one  case  was  the  data 
extrapolated  beyond  the  range  of  independent  variables  actually  investigated. 


The  "expected  fit"  criteria  differs  from  the  more  familiar  "significance 
test  criteria"  usually  used  with  multiple-regression  techniques.  Its 
intent  is  to  maximize  the  correlation  of  the  predicted  data  with  data 
obtained  in  identical  subsequent  experiments.  Conversely,  the  "signifi¬ 
cance  test"  criteria  is  concerned  with  the  likelihood  that  the  variance 
associated  with  a  particular  term  is  due  to  experimental  error. 
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It  should  also  be  noted  that  all  the  graphs  represent  predictions  for 
the  average  _S,  Those  graphs  showing  the  relationship  between  the 
dependent  variable  and  the  display  size  represent  predictions  for  a  point 
late  in  the  experiment  where  S_' s  condition  mastery  was  at  its  maximum. 

A  standardized  format  was  developed  for  summarizing  the  results  of 
the  multiple-regression  analyses  for  the  various  experiments.  An  example 
of  this  format  is  shown  in  figure  12  and  is  explained  below.  Each  row 
of  the  matrix  shown  in  figure  12  represents  the  results  of  the  analysis 
for  the  particular  dependent  variable  identified  in  the  left-hand  margin. 
In  all  cases,  more  than  one  Independent  variable  was  analyzed. 


The  classes  of  predictor  variables  selected  are  identified  in  the 
upper  margin  of  the  columns  to  the  left  of  the  double  line.  The  number 
of  individual  variables  falling  in  each  class  is  shown  in  the  associated 
cell  of  the  matrix.  To  illustrate  the  meaning  of  "classes”  of  predictor 
variables,  if  display  size  (display  size)^  and  (display  size)-*  were 
all  selected  as  predictor  variables,  all  three  will  logically  fall  into 
a  "class 'which  could  reasonably  be  termed  "display  size."  Thus,  display 
size  would  be  shown  adjacent  to  one  of  the  columns  and  the  number  "3" 
shown  in  the  corresponding  cell  below.  The  reader  is  cautioned  against 
attaching  special  meaning  to  the  order  of  presentation  of  the  variable 
classes  or  to  the  number  si  variables  within  each  class  ns  neither  has 
any  bearing  on  the  relative  "importance"  of  the  predictor  variables.  The 
relative  importance  of  the  variable  classes  and  the  individual  variables 
within  these  classes  can  be  determined  only  by  examining  plots  of  the 
predicted  data  directly. 


The  total  number  of  predictor  variables  included  in  the  regression 
equation  is  shown  in  the  first  column  to  the  right  of  the  double  line  in 
figure  12.  The  second  column  to  the  right  of  this  line  shows  the  total 
number  of  data  points  (experimental  trials)  upon  which  the  analysis  was 
based. 


Proceeding  to  the  right,  the  next  two  columns  list  an  F-ratio  and 
show  the  probability  with  which  an  F-ratio  of  this  size  would  have  occurred 
by  chance.  The  F-ratio  was  obtained  by  dividing  the  ratio  of  the 
"variance  accounted  for”  over  its  degrees  of  freedom  by  the  ratio  of  the 
"residual"  over  its  degrees  of  freedom.  Its  significance  indicates  the 
unlikeliness  of  the  results  due  to  chance  fluctuations. 

—2 

The  column  labeled  R  is  interpreted  as  the  proportion  of  variance 
in  the  dependent  variable  accounted  for_^y  the  composite  of  predictor 
variables  ^.n  the  regression  equation.  R  is  obtained  by  subtracting  the 
ratio  of  the  Residual  and  Total  sums  of  squares  from  1,  and  its  interpreta¬ 
tion  is  analogous  to  the  interpretation  of  error  SS  in  analysis-of-variance 
designs.  In  the  broadest  sense,  R2  is  an  index  of  the  degree  to  which  the 
model  fits  the  data.  In  order  to  provide  an  index  for  evaluating  the 
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magnitude  of  R  ,  one  should  consider  that  the  "average"  experiment 
reported  in  the  psychological  literature  accounts  for  roughly  10  percent 

of  the  total  variance. 

The  multiple  correlation  coefficient  (R)  is  shown  in  the  right-hand 
column  of  figure  12.  R  is  obtained  i.y  taking  the  square-root  of  and 
is  an  index  of  the  validity  of  the  regression  equation. 

ROLL  ANGLE  EXPERIMENTS 

The  overall  objective  of  the  set  of  three  experiments  reported  in 
this  section  was  to:  (a)  define  the  relationship  between  display  size 
and  error  in  roll  angle  judgments  and  (b)  to  obtain  reliable  estimates 
of  the  absolute  accuracy  with  which  roll  angle  can  be  judged  from  the 
basic  VCAD.  The  task  in  the  first  two  experiments  was,  essentially,  a 
tracking  task  which  required  Ss  to  detect  and  null  roll  angle  error, 
where  error  is  defined  as  the  momentary  difference  between  the  roll 
angle  appearing  on  the  display  and  an  assigned  "standard"  roll  angle.  A 
forcing  function  was  used  in  both  experiments  which  continuously  forced 
roll  angle  off  the  standard.  All  other  flight  parameters  remained  con¬ 
stant  in  the  first  experiment.  It  was  discovered,  however,  that  this 
experimental  arrangement  provided  unrealistically  powerful  cues  to  roll 
angle — cues  that  would  not  be  available  in  an  actual  flight  situation. 

For  this  reason,  the  experiment  was  replicated  with  a  forcing  function 
also  being  introduced  into  pitch  angle,  although  £>  still  maintained 
control  of  only  roll  angle.  This  procedural  change  forced  £  to  adopt 
cues  that  are  general izable  to  a  complex  flight  situation. 

The  third  experiment  in  this  set  measured  the  accuracy  with  which 
S9  could  set  roll  angle  to  each  of  a  number  of  values.  Whereas  the 
first  experiments  were  concerned  with  S/s  ability  to  continuously  detect 
and  null  error  from  a  standard,  the  third  experiment  was  concerned  with 
JJ's  ability  to  make  absolute  judgments  of  the  magnitude  of  roll  angle. 

Roll  Angle  Maintenance  Experiments 

Subjects 

Four  laboratory  personnel  were  used  as  Ss  All  Ss  were  initially 
flight  naive,  having  had  no  prior  flight  experience  nor  any  previous 
experience  judging  the  value  of  flight  parameters  from  the  VCAD.  The  same 
four  S3  were  used  in  both  experiments  so  their  level  of  learning  was 
substantially  higher  during  the  second  experiment. 

Apparatus 

These  experiments  were  conducted  in  the  laboratory  facility  des¬ 
cribed  in  the  General  Apparatus  section  of  this  report.  The  special 
features  specific  to  these  experiments  are  described  below. 
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1.  The  joystick  Id  the  fixed-based  cockpit  was  aodlfied  to  HHv« 
mil  angle  only.  Movement  of  the  stick  to  the  right  of  the  null  posi¬ 
tion  caused  the  horlson  line  to  tilt  toward  the  lefti  whereas,  movement 
to  the  left  of  the  null  position  caused  the  horlson  line  to  tilt  toward 
the  right.  This  display-control  ralatlonshlp  la  directly  analogous  to 
that  In  an  aircraft.  The  rate  of  change  in  roll  angle  was  a  function 
of  the  amount  of  displacement  from  the  null  position. 

2.  A  forcing  function  was  introduced  into  the  roll  angle  channel  in 
both  the  original  and  the  replicated  experlmant.  A  forcing  function 
was  also  Introduced  into  the  pitch  angle  channel  during  the  replicated 
experiment  although  £  had  no  control  of  pitch.  The  magnitude  and  fre¬ 
quency  of  the  sine  wave  forcing  function  driving  roll  angle  was  2.6  cpm 
and  +  IS  degrees  respectively.®  Roll  angle  could  be  made  to  oscillate 
about  a  refarenca  point  which  waa  systematically  varied  throughout  tha 
experiment.  The  sine  wave  forcing  function  driving  pitch  caused  pitch 
angle  to  oscillate  about  sero  pitch  at  a  rata  of  2.0  cpm  and  a  magnitude 
of  +15  degrees. 

3.  A  5-inch  display  waa  not  available  at  this  time  so  only  8-, 

14- ,  and  17-lnch  displays  ware  investigated. 

4.  The  performance  indexes  obtainsd  included  AAE,  SMS  error,  AS 
and  oscillographic  records  of  momentary  error  and  momentary  roll  angle 
on  the  first  and  the  last  two  trials  of  each  sessions. 

Procedure 

Tha  £'a  task  in  these  experiments  was  to  maintain  a  standard  roll 
angle  (either  0,  20,  or  60  degrees)  over  a  two-minute  trial  using 
either  an  8-,  14- ,  or  17-lnch  display.  Each  £  performed  ten  such  trials 
during  each  of  nina  sessions.  Tha  else  of  the  display  and  tha  roll 
angle  standard  remained  constant  during  any  one  session,  but  varied 


Low  frequency  and  low  amplitude  forcing  functions  were  deliberately 
selected  to  ensure  that  the  limiting  feature  of  the  perceptual-motor 
task  waa  the  perceptual  portion  rather  than  the  motor  portion  of  the 
teak.  This  procedure  ensures  that  any  difference  in  task  proficiency 
la  a  function  of  £'■  ability  to  decode  the  display  rather  than  his 
ability  to  encode  hie  response.  It  was  originally  feerad  that  use  of 
an  entirely  periodic  forcing  function  might  allow  the  subject  to  memo¬ 
rise  special-temporal  aspects  of  the  forcing  function  end  thus  be 
able  to  null  error  without  referencing  the  display.  This  possibility 
was  checked  by  asking  highly  trained  jga  to  perform  the  task  for  one 
minute  in  the  ordinary  manner  and  for  the  next  minute  with  their  eyes 
closed.  Although  £s  were  able  to  reproduce  the  amplitude  with  a  fair 
degree  of  accuracyT  their  timing  very  quickly  became  out  of  phase  with 
the  forcing  function  with  the  result  that  error  far  exceeded  that 
obtained  on  any  trial  during  the  experiment. 
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systematically  from  session  Co  session.  The  order  with  which  each  of 
tho  nine  possible  combinations  of  display  size  and  roll  angle  standard 
■wore  administered  is  shown  in  table  2.  This  order  constitutes  a 
fractional  Latin  Square  design  and  was  obtained  by  randomly  selecting 
four  rows  from  a  standard  9x9  Randomised  Latin  Square.  This  design 
ensures  that  each  display  sise  is  represented  at  least  once  during  each 
of  the  nine  sessions  and  further  ensures  that  each  S,  receives  each 
combination  once  during  the  experiment. 

Prior  to  the  first  trial  the  nature  of  the  tRsk  was  carefully 
explained  to  the  j5s  and  they  were  given  the  opportunity  to  become 
familiar  with  the  dlaplay/control  relationship.  Prior  to  each  session 
roll  Sngla  wee  eat  on  the  appropriate  standard.  The  Ss  were  told  that 
the  roll  angle  which  presently  appeared  on  the  display  was  the  standard 
which  they  were  to  maintain.  They  were  further  instructed  to  spend  the 
lnter-trlal  Interval  trying  to  memorise  the  standard.  Subjects  were 
^.von  a  verbal  ready  signal  and  verbal  signals  to  indicate  initiation 
and  termination  of  each  trial.  During  the  inter-trial  interval,  which 
was  spproxlmately  one-minute  in  length,  the  experimenter  recorded  the 
error  date  from  e  digital  voltmeter. 

Result  a 

The  results  of  the  first  experiment  showed  that  after  only  a  moderate 
amount  of  practice,  £a  wore  able  to  maintain  all  of  the  three  roll  angle 
standards  with  the  same  remarkably  high  degree  of  accuracy  regardless  of 
the  slsa  of  the  display  being  used.  Peak  error  aeldom  exceeded  two  degrees 
during  e  trial  end  the  absolute  error  averaged  over  a  trial  was  less  than 
one-half  degree.  These  flndlnga  were  immediately  suspect  and  led  to  a 
careful  examination  of  the  strategies  used  by  the  S,s  it  was  discovered 
that,  without  axoaptlon,  &*  sought  out  some  type  of  extraneous  raferance 
point  on  either  the  face  of  tho  display  or  on  its  edge  which  happened  to 
be  in  alignment  with  the  horlaon  line,  e  breakpoint  line,  or  a  perspective 
line  when  roll  angle  was  in  the  standard  position.  On  subsequent  trials 
they  simply  proceeded  to  maintain  alignment  of  these  two  arbitrary  refer- 
enca  points/ 

Because  a  different  external  reference  point  was  required  for  each 
display  slss  and  each  roll  sngla  standard,  a  wids  variety  of  extraneous 
items  were  used  ea  reference  points.  These  included  the  corners  of  the 
display,  minute  smudges  and  specks  on  the  tube  face,  smell  scratches  and 
smudges  or.  the  tube  mounting,  etc. 

In  considering  the  legitimacy  of  this  strategy  it  became  apparent 
that  it  would  be  appropriate  only  when  pitch  angle  remained  constant— a 
condition  that  would  rarely  exist  in  a  flight  situation  for  any  signifi¬ 
cant  period  of  time.  For  this  reason  the  study  was  judged  invalid  for  Its 
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intended  purpose,  and  the  decision  was  made  to  replicate  the  experiment 
using  a  forcing  function  in  pitch  angle  as  well  as  roll  angle.  This 
procedure  forced  8,  to  adopt  strategies  that  would  ue  appropriate  in  an 
actual  flight  situation. 

Although  invalid  for  its  Intended  purpose,  one  finding  of  the  study 
Is  worthy  of  mention.  The  tendency  of  JSs  to  search  out  external  refer¬ 
ences  and  their  reluctance  to  rely  upon  the  internal  cue  of  "memory"  of 
the  standard  appears  to  be  universal.  Whether  this  tendency  is  due  to 
the  Inherent  features  of  the  visual  mechanism  or  due  to  past  experience 
with  conventional  displays  remains  to  be  answered. 

The  results  of  the  multiple  regression  analysis  for  the  replicated 
roll  angle  experiment  are  summarised  in  figure  13.  It  can  be  seen  that 
analysts  wire  psrformed  for  thrss  different  criteria,  vis.,  AAE,  RMS, 
and  AS.  It  waa  found  that  AAE  and  RMS  error  correlated  very  highly  (.97) 
indicating  that  the  earns  trends  were  manifest  in  both  measures.  It  was 
slao  found  that  AE  was  affectively  taro  by  the  senventh  session,  indicat¬ 
ing  that  there  ware  no  consistent  biases  and  that  errors  were  symmetri¬ 
cally  distributed  about  the  standard.  Given  these  two  findings,  RMS  error 
can  be  confidently  assumed  to  be  a  reliable  estimate  of  the  standard 
deviation  of  the  error  about  the  standard.  Since  standard  deviation 
units  are  the  most  easily  translatable,  predicted  data  for  only  RMS  error 
is  presented  in  the  following  graphs. 

First  note  that  the  multiple  regression  equation  that  evolved  from 
the  analysis  is  composed  of  six  classes  of  predictor  variables  and  a 
total  of  11  individual  predictor  variables.  The  highly  significant 
F-rstlon  (33.6  with  11  and  359  df)  indicates  that  this  veighted  combina¬ 
tion  of  predictor  variables  accounts  for  n  highly  significant  proportion 
of  the  total  variance.  The  proportion  of  variance  accounted  for  (IT  ■  51 
percent)  end  the  multiple  correlation  coefficient  (IT  *  .71)  indicate  that 
the  equation  is  an  effective  and  valid  estimator  of  RMS  error.  Every 
Indication  auggeets  that  the  predicted  scores  derived  from  the  regression 
equation  are  highly  generallxsbls. 

Examining  the  classes  of  predictor  variables  shown  in  figure  13,  it 
can  be  seen  that  display  alee—  the  variable  of  primary  Interest— was 
selected  se  s  predictor  variable.  This  finding  indicates  that  judgment 
error  is  Indeed  dependent  upon  the  size  of  the  display  being  used.  The 
selection  of  the  standard  x  display  size  Interaction  indicates  that  the 
effect  of  display  size  on  judgment  error  differs,  depending  upon  the 
magnitude  of  the  roll-angle  standard.  The  nature  and  magnitude  of  these 
effects  are  illuatrated  in  figure  14,  which  shows  RMS  in  minutes  of  arc 
as  a  function  of  display  size  and  standard  roll  angle.  These  curves 
represent  predictions  to  a  point  late  in  learning  (session)  for  the  average 
ji.  The  curves  for  the  20-inch  and  5-inch  displays  represent  extrapolations 
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preted  with  reservation.  A  high  degree  of  confidence  can  be  placed  on  all 
other  predicted  points  however. 


Figure  14  shows  that  the  "optimal"  display  size  is  dependent  upon 
the  magnitude  of  the  roll  angle  being  judged.  If  the  roll  angle  standard 
falls  below  about  18  degrees,  larger  size  displays  are  favored;  if  the 
roll  angle  standard  exceeds  18  degrees,  smaller  sizes  prove  optimal.  Con¬ 
sidering  the  data  overall,  an  11-lnch  display  would  appear  to  be  the  most 
effective  trade-off  for  minimizing  judgment  error  over  a  wide  range  of 
roll  angles. 


The  magnitude  of  the  difference  between  the  best  and  the  worat  con¬ 
dition  in  figure  14  can  be  zesn  to  be  relatively  small.  Error  la  found 
to  be  minimum  when  a  20-inch  display  is  used  to  judge  e  roll  angle  stan¬ 
dard  of  zero  degrees  and  la  maximum  whan  the  same  display  size  la  uaad  to 
Judge  60-degree  roll  angles.  Although  the  difference  between  these  two 
conditions  (about  40  mlnutaa  of  arc)  is  highly  statistically  significant. 

It  would  appear  to  have  little  practical  importance. 

Turning  to  the  question  of  the  absolute  accuracy  with  which  one  can 
expect  roll  angle  to  be  maintained,  it  ia  necessary  to  establish  a  level 
of  confidence.  If  one  defines  an  Interval  aa  3  standard  deviation  units  on 
either  aide  of  the  roll  angle  standard,  it  can  be  assumed  that  roll  angle 
can  be  maintained  within  this  interval  99.74  percent  of  the  time.  Apply¬ 
ing  this  confidence  criterion  to  the  data  for  the  11-lnch  display,  one  can 
state  that  at  a  60-degree  roll  angle,  the  average  S,  should  maintain  roll 
angle  within  +3.15  degrees  of  the  standard  99.74  percent  of  the  time  and 
that  he  should  never  perform  worse  then  this  regardless  of  the  roll  angle 
he  desires  to  maintain. 


Although  not  of  primary  interest,  aavaral  of  '.he  other  predictor 
variables  should  be  discussed.  A  predictor  variable  for  Sa  .  indicates 
that  Individual  jJa  performed  differently  and  a  subject  x  sessions  pre¬ 
dictor  variable  Indicates  that  different  S«  learn  at  different  rates. 

This  effect  is  the  reason  why  traditional  analysis  of  variance  models  wars 
inappropriate  for  these  data. 

Selection  of  a  sessions  predictor  variable  indicates  that  judgment 
error  changed  as  a  function  of  practice.  The  sessions  x  standards  pre¬ 
dictor  variable  indicates  that  this  change  was  not  the  same  for  all  roll 
angle  standards.  These  effects  are  graphically  Illustrated  in  figure  15 
which  shows  RMS  error  as  a  function  of  sessions  and  roll  angle  standard. 
These  curves  represent  predicted  date  for  the  11-inch  display  and  the 
average  S..  The  alight  upturn  of  the  two  lower  curves  is  an  artifact 
resulting  from  fitting  a  quadratic  equation  to  the  data.  It  can  safely  be 
assumed  that  the  error  score  for  session  7  represents  the  true  aayptotic 
level  of  these  conditions.  The  Important  trend  in  figure  15  is  that  the 
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curves  tend  to  converge  with  practice.  Although  all  Ss  were  highly 
practiced  oy  tne  nintn  session.  It  is  possible  that  the  differences 
between  roll  angle  standards  would  have  eventually  “washed-out"  with 
sufficient  training.  J 

Discussion 


The  prediction  that  the  accuracy  of  maintaining  a  fixed  roll  angle 
would  Increase  as  a  simple  function  of  display  size  was  not  confirmed  by 
these  data.  No  satisfactory  explanation  for  the  curious  Interaction 
between  display  size  and  roll  angle  standard  is  available  at  this  time, 
although  a  number  of  possible  contributory  effects  can  be  hypothesized. 
The  difference  between  roll  angle  standards  is  likely  to  be  a  function 
of  S/s  past  experience.  He  hae  had  more  experience  Judging  the  horizon-. 
talness  of  objects,  so  it  seems  reasonable  that  zero  degrees  would  be 
the  easiest  condition  regardless  of  display  size.  Since  zero  degrees 
is  familiar  to  j>,  and  since  the  tip  of  the  horizon  line  moves  through 
greater  excursions  for  largsr  displays,  it  also  seems  reasonable  that 
larger  displays  would  be  favored  st  small  roll  angles. 

To  explain  why  smaller  displays  are  favored  at  large  roll  angles, 
one  must  consider  that  (a)  although  proficiency  in  the  task  la  a  func¬ 
tion  of  S/s  ability  to  detect  and  null  temporary  changes  from  the 
standard,  some  long  term  drift  in  error  is  bound  to  occur  and  (b)  the 
ability  to  null  this  Tong  term  drift  is  a  function  of  S/s  ability  to 
learn  and  recall  the  standard.  Accepting  these  facte,  it  seems  reaeon- 
able  to  hypothesize  that  because  larger  displays  subtend  such  a  large 
visual  angle,  a  clear  image  of  the  composite  configuration  would  be  more 
difficult  to  attain. 

The  surprising  degree  of  accuracy  with  which  roll  angle  could  be 
maintained  suggests  that  the  basic  VCAD  may  be  more  self  sufficient  than 
had  previously  been  supposed. 

Absolute  Judgment  of  Roll  Angle 

The  key  objective  of  this  experiment  was  to  determine  the  accuracy 
with  which  absolute  roll  angle  judgments  can  be  made  with  the  basic  VCAD, 
and  to  determine  whether  Judgment  accuracy  varies  as  a  function  of  dis¬ 
play  size.  In  the  previous  experiments  task  proficiency  was  a  function 
of  S's  ability  to  detect  change  in  roll  angle  whether  or  not  he  could 
attach  any  numerical  value  to  the  change.  The  present  experiment  is 
concerned  with  measuring  S/s  ability  to  extract  quantitative  information 
regarding  roll  angle  from  the  basic  display. 

This  experiment  also  served  a  secondary  objective.  The  question  was 
raised  as  to  whether  the  use  of  non-pilots  in  these  basic  experiments 
would  result  in  valid  data.  Although  the  roll  angle  maintenance  task  was 
deliberately  designed  to  minimize  the  effects  of  past  experience  and  to 
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■ini wise  complex  skill  requirements, the  possibility  existed  that  experi¬ 
enced  pilots  who  had  had  considerable  experience  judging  roll  angles  in 
18  flight  situation  might  have  developed  more  skill  in  making  absolute 
XttU  angle  judgments  than  could  be  developed  by  non-pilots,  even  after 
considerable  practice.  Flight  experience  was  therefore  Introduced  as  an 
additional  independent  variable  in  this  study. 

Subjects 

Three  experienced  Naval  aviators  and  three  non-pilot  laboratory 
personnel  served  as  J5's  in  this  experiment.  The  pilot  population  had 
no  previous  experience  with  the  VCAD.  The  non-pilot  S/s  had  served  in 
tlMr  previously  described  experiment  concerned  with  roll  angle  mainte¬ 
nance.  However,  they  had  no  familiarity  with  ascribing  numerical  values 
to  roll  angle  other  than  the  three  roll  angle  standards  used  in  the 
roll  angle  maintenance  study,  viz.,  0-,  20-,  and  60  degrees. 

Agftttua 

The  apparatus  used  In  this  experiment  was  essentially  the  same  as 
that  utilised  in  the  roll  angle  maintenance  experiment  except  that  the 
forcing  functions  was  not  introduced  into  the  roll  angle  channel  as 
before.  Functionally,  the  apparatus  gave  £  the  capability  of  adjusting 
roll  angle  to  any  desired  magnitude  by  manipulating  the  control  stick 
in  the  lateral  plane.  Roll  angle  could  be  maintained  at  a  stable  posi¬ 
tion  by  simply  returning  the  stick  to  its  null  position  after  roll  angle 
had  reached  the  desired  position. 

The  PMS  was  modified  to  provide  a  direct  read-out  of  the  roll  angle 
on  the  digital  voltmeter.  The  voltmeter  presented  roll  angle  rounded  to 

the  merest  degree. 

Procedure 

The  method  by  which  absolute  roll  angle  judgments  were  measured  in 
this  experiment  is  aa  follows:  Twenty-five  angles,  varying  from  60  degrees 
left  roll  to  60  degrees  right  roll  in  S-degree  Increments  were  selected 
as  roll  angle  standards.  The  experimenter  sequentially  presented  these 
standards  to  Si  by  verbally  calling  out  the  direction  and  the  value  of  the 
standard;  e.gT,  "15  degrees  left  roll,"  "25  degrees  right  roll,"  etc. 

The  S,  then  proceeded  to  adjust  roll  angle  to  what  he  judged  to  be  the 
prescribed  standard,  signaling  the  experimenter  as  to  when  he  had  com¬ 
pleted  his  adjustment  by  celling  "mark."  The  experimenter  then  recorded 
8>  actual  roll  angle  Betting  and  proceeded  to  the  next  standard. 

Although  this  wee  a  self-paced  task,  J5's  were  instructed  to  "not  expend 
•n  inordinate  amount  of  time  in  making  a  judgment." 


A  trial  in  this  experiment  is  defined  as  one  roll  angle  judgment; 
and  a  block  of  trials  consists  of  26  judgments.  Each  of  the  25  roll 


angle  standards  was  judged  once  during  a  block  of  trials  except  for  the 
zero-degree  standard  which  wan  Judged  twice.  The  order  of  presentation 
of  the  standards  was  arranged  randomly  within  blocks. 

The  initial  session,  hereafter  designated  as  session  zero,  consisted 
of  three  blocks  of  trials  in  which  S_'s  were  given  no  information  as  to  the 
accuracy  of  their  judgments.  This  "no  feedback"  condition  was  necessary 
in  order  to  obtain  accurate  estimates  of  the  relative  skill  of  pilots  and 
non-pilots  prior  to  learning  taking  place.  Thereafter,  non-pilot  S/s 
performed  six  additional  sessions  of  two  blocks  each;  receiving  feedback 
as  to  their  actual  setting  Immediately  after  each  trial.  Although  the 
difference  in  pilot's  and  non-pilot's  judgment  accuracy  prior  to  laamlng 
was  the  primary  concern,  the  pilots  consented  to  participate  in  3  addi¬ 
tional  blocks  of  feedback  trials.  Feedback  was  given  by  verbally  inform¬ 
ing  S/s  of  the  magnitude  of  their  setting  In  degrees. 

Roll  angle  judgments  were  measured  under  three  conditions  of  display 
size;  viz.,  8-,  14-,  and  17-inch  displays.  The  order  of  presentation  of 
display  size  Is  illustrated  in  table  3.  The  row  adjacent  to  each  S. 
number  lists  the  sequential  order  with  which  that  £>  received  the  three 
displays.  This  design  ensures  that  each  £  receives  the  displays  with 
equal  frequency  and  ensure  that  each  display  size  Is  used  equally  often 
at  each  stage  of  practice. 

Results 


The  results  of  the  multiple  regression  analysis  are  shown  in  figure 
16.  It  will  be  recalled  that  AAE  Is  the  average  of  the  absolute  dif¬ 
ference  between  the  actual  and  the  standard  setting,  whereas  AE  Is  the 
average  of  this  difference  when  summed  with  respect  to  sign.  The  value 
of  the  standard  was  subtracted  from  that  of  the  actual  setttlng  so  that 
a  positive  difference  indicates  that  the  setting  was  too  large  and  a 
negative  difference  indicates  that  the  setting  was  too  small. 

Figure  16  indicates  that  the  regression  equations  for  AAE  and  AE, 
both  composed  of  13  predictor  variables,  accounts  for  a  statistically 
significant  portion  of  the  total  variance  (F-ratios  of  30.5  and  13.7  for 
AAE  and  AE  respectively).  The  regression  equation  derived  for  AAE  is 
seen  to  account  for  19.5  percent  of  the  total  variance  and  that  for  AE, 
9.8  percent.  These  values  indicate  the  presence  of  considerably  more 
experimental  error  that  was  found  in  the  previous  experiment.  Upon 
subsequent  examination  of  the  experimental  procedures  it  seemed  likely 
that  a  large  portion  of  this  error  resulted  from  measuring  judgment 
error  to  only  the  nearest  degree  accuracy.  Although  this  fact  doeB  not 
invalidate  the  results  of  the  experiment,  it  may  tend  to  produce  slightly 
conservative  estimates  of  Judgment  accuracy.  That  is,  judgments  may  be 
made  with  slightly  greater  accuracy  than  is  indicated  by  the  regression 
equation. 
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Considering  the  seta  of  predictor  variables  chosen  by  the  analysis, 

I’ttA  MAM  *•  s4m«|4  £4  »  MM  *■  C. f  mJ4  -4  *-U  -  A.  1 Ji  .  1  ...  _  I  .  ■  l  1  1  *  1 

— —  ~ -o— -*■ -■w—.w  vuut.  wuc  Miopia;  o if>c  vauai/ic  uiu  nut 

prove  to  be  e  predictor  of  either  AAE  or  AE.  On  the  basis  of  this  find¬ 
ing,  it  can  be  concluded  that  display  size  had  no  measurable  effect  on 
bile  accuracy  with  which  absolute  roll  angle  judgments  can  be  made. 

Another  independent  variable  of  interest  was  "Flight  Experience" 
(pilots  vs  non-pilots).  It  can  be  seen  that  flight  experience  proved 
to  be  e  predictor  of  both  AAE  and  AE.  The  effects  of  both  flight 
experience  and  sessions  (practice)  on  AAE  Is  illustrated  in  figure  17. 

The  curves  in  figure  17  represent  predicted  data  for  the  30-degree 
Standard  which,  as  will  be  seen  later,  is  the  standard  at  which  AAE 
waa  maximum.  These  curves  are  therefore  to  be  considered  the  "worst 
case"  condition.  It  was  surprising  to  find  that  judgment  error  for 
pilots  is  considerably  greeter  than  that  for  non-pilotB.  Evidently, 
the  knowledge  of  the  position  of  0*,  20-,  and  60  degree  standards 
obtained  from  having  served  sa  _S's  in  the  roll  angle  maintenance  experi¬ 
ment  was  sufficient  to  give  non-pilots  this  edge.  Since  there  is  no 
reason  to  believe  that  non-pilots  would  be  inately  superior  at  this 
type  of  judgment  task,  it  would  seem  certain  that  error  for  the  two 
group*  would  have  converged  to  the  same  level  had  practice  been  con¬ 
tinued.  It  la  aleo  worthy  of  note  that  the  learning  curve  for  non- 
pilots  appears  to  have  nearly  leveled  off  by  session  6,  although  some 
Plight  improvement  would  still  be  expected  with  additional  practice. 

The  effects  of  roll  angle  standard  upon  AAE  is  illustrated  in 
figure  18.  This  figure  shows  AAE  as  a  function  of  the  magnitude  of  the 
roll  angle  standard  for  both  pilots  and  non-pilots.  Note,  however,  that 
the  curve  for  pilot  performance  is  predicted  for  session  1  while  the 
curve  for  the  non-pilot  performance  ie  predicted  for  session  6.  Since 
no  difference  was  noted  for  roll  direction,  these  curves  can  be  con¬ 
sidered  representative  for  both  left  and  right  roll  angles. 

The  similarity  in  shape  of  the  pilot  and  non-pilot  curves,  despite 
the  large  difference  in  the  amount  of  practice  under  feedback  conditions, 
suggests  that  the  two  curves  would  probably  be  the  same  given  equivalent 
practice.  The  finding  that  AAE  ie  very  smell  at  zero  degrees  and 
Incraases  as  a  function  of  the  magnitude  of  the  roll  angle  standard  Is 
not  particularly  surprising.  That  is,  judgment  of  horizontalness  and 
vsrtlealnsas  la  a  common  requirement  in  everyday  experience,  but  one  is 
seldom  faced  with  having  to  quantify  the  amount  of  slope  or  tilt  of  objects 
without  the  aid  of  a  measuring  device. 

The  feet  that  judgment  error  differs  so  greatly  from  standard  to 
standard  makaa  it  difficult  to  make  a  simple  quantitative  statement 
regarding  ths  accuracy  with  which  roll  angle  can  be  decoded  from  the 
basic  display.  To  facilitate  ths  formulation  of  such  statements,  a  second 
scale  ie  provided  on  the  right-hand  margin  of  figure  18  making  It  possible 
to  read  arror  for  each  of  ths  standards  in  standard  deviation  units  (note 
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Figure  11.  Average  Abaeluta  Error  ol  Kail  Angle  Judgmante  ai  •  Function  of  Kell  Anglo  Standard.  Tha 
gllot  data  ora  predicted  for  oaaalon  1  and  the  non-pilot  data  ora  predicted  for  faction  6. 
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the  equality:  SD  ■  1.5  (AAEl^.  As  an  avamnio  nf  H->e  mci-.r.cr  in  which 
figure  18  can  be  used  in  making  statements  regarding  absolute  decoding 
accuracy,  assume  one  is  Interested  in  the  accuracy  with  which  the  20- 
dcgrcc  standard  can  be  expected  to  be  judged.  Figure  18  shows  the 
standard  deviation  for  the  20-degree  condition  to  be  approximately  3.9 
degrees.  Assuming  that  errors  are  normally  distributed  about  the 
standard  and  assuming  one  wishes  to  attach  a  high  degree  of  confidence 
to  his  statement,  say  the  99  percent  level,  the  i  the  statement  can  be 
made  that  the  "average"  .S  will  adjust  roll  angle  to  within  +3  (3.9)  ■ 

+11.7  degrees  of  the  standard  in  99.97  percent  of  his  attempts. 

Figure  1°  illustrates  the  relationship  between  AE — a  measure  of 
judgment  bias — and  magnitude  of  the  roll  angle  standard.  The  curve  in 
figure  19  represents  predicted  AE  for  non-pilots  after  six  training 
sessions.  Except  for  the  2ero-degree  standard,  a  positive  score  indi¬ 
cates  that  the  average  setting  was  larger  than  the  corresponding 
standard.  Conversely,  a  negative  score  Indicates  that  the  average 
setting  was  smaller  than  the  standard.  For  the  zero-degree  standard, 
a  positive  AE  score  indicates  a  right  roll,  and  a  negative  acore 
Indicates  a  left  roll.  For  example,  the  positive  .3-dcgree  AE  score 
for  the  zero-degree  standard  indicates  that  when  j>'s  judge  roll  ansle 
to  be  zero,  the  horizon  line  is  actually  tilted  to  the  left  an  average 
of  .3-degrees. 

Figure  19  shows  that  a  small  amount  of  judgment  bias  exists  but 
that  the  bias  is  not  consistent  across  all  roll  angle,  Angles  leas 
than  45-degrees  tend  to  be  overestimated.  That  is,  the  average  S, 
tends  to  perceive  his  settings  as  being  larger  than  they  are  in  reality. 
Angles  larger  than  45  degrees  tend  to  be  underestimated,  suggesting  that 
Ss  perceive  large  angles  to  be  smaller  than  they  are  in  reality.  Maxi¬ 
mum  negative  bias  (.7  degrees)  is  seen  to  occur  at  the  25-degree  standard, 
and  maximum  positive  bias  (.95  degrees)  at  the  60-degree  standard. 

Although  the  presence  of  this  bias  invalidates  the  assumption  that  errors 
are  normally  distributed  about  the  standard,  the  bias  is  bo  small  for 
most  conditions  that  the  estimates  of  decoding  accuracy  derived  from 
figure  18  will  be  affected  by  only  a  small  amount. 

A  second  prediction  made  earlier  was  derived  from  the  fact  that  the 
magnitude  of  the  excursion  through  which  the  "tip"  of  the  horizon  line 
travels  as  a  function  of  an  increment  in  roll  angle  is  greatest  at  a  roll 
angle  of  39  degrees.  It  was  predicted  that  accuracy  should  tend  to 
improve  as  the  roll  angle  standard  approached  39  degrees.  Although  a 
dip  in  the  error  curve  was  noted  in  the  vicinity  of  39  degrees,  the  dip 
appeared  to  be  symmetrical  about  a  minimum  of  50  degrees. 

PlacusBlon 

The  results  of  this  experiment  confirmed  the  prediction  made  earlier 
that  display  size— within  the  range  of  Interest  here— would  have  no 


Figure  19.  Average  Error  «  e  Function  of  Roll  Angle  Standard.  Predicted  data  (or  non-pilot  population  an  oeesion  (. 


effect  uu  tlie  accuracy  with  which  absolute  roll  angle  judgments  can  b« 
made.  A  finding  that  was  not  predicted  was  the  superior  initial  per¬ 
formance  of  non-pilots  over  pilots.  It  was  stated  previously  that  this 
difference  was  undoubtedly  due  to  the  non-pilots  becoming  familiarized 
with  the  0-,  20- ,  and  60-degree  standards  in  a  previous  experiment* 
Evidently  knowledge  of  theae  three  standards  enabled  these  8s  to  inter¬ 
polate  to  intermediate  standards  with  a  fair  degree  of  accuracy.  It  is 
nevertheless  surprising  that  pilots  had  not  established  similar  internal 
references  to  roll  angle  magnitude  during  their  flight  experiences.  This 
may  suggest  that  little  learning  of  this  type  will  take  place  so  long  aa 
external  references  such  as  the  reference  marks  on  ADI  displays  are 
Immediately  available. 

Although  average  bias  was  small,  It  is  interesting  to  speculate  as 
to  why  the  bias  curve  was  of  its  particular  shaps.  One  possibla  explana¬ 
tion  is  as  follows:  In  making  a  setting,  £  must  reference  roll  angle 
magnitude  to  some  point  with  which  he  is  familiar,  the  most  llkaly 
candidates  would  appear  to  be  zero  or  90  degrees.  If  £  references 
zero  degree  and  his  natrual  tendency  is  to  overestimate  the  difference 
between  his  setting  and  his  reference  point,  then  his  setting  will 
tend  to  be  too  small.  Similarly  if  he  references  90  degrees  and  dis¬ 
plays  the  same  tendency  to  overestimate  the  difference  between  hla 
setting  and  his  reference,  then  his  settings  will  be  too  large.  If  S. 
referenced  zero-degree  when  judging  angles  less  than  45  degrees  and 
referenced  90  degrees  when  judging  angles  larger  than  45  degrees  one 
would  expect  precisely  the  bias  curve  presented  in  figure  19. 


ALTITUDE  EXPERIMENTS 

The  purpose  of  the  two  experiments  reported  here  was  to  define  the 
nature  of  the  relationship  between  display  size  and  the  accuracy  of 
altitude  judgments,  and  to  obtain  reliable  estimates  of  the  absolute 
accuracy  with  which  altitude  can  be  judged  from  the  VCAD.  Two  types 
of  judgment  skill  were  investigated.  The  first  experiment  was  designed 
to  measure  the  type  of  judgments  utilized  in  maintaining  altitude  at  a 
constant  level  and  is  referred  to  as  the  altitude  maintenance  experiment. 
Proficiency  in  this  task  is  dependent  upon  S/s  ability  to  detect  and  to 
null  change  in  altitude  regardless  of  whether  he  is  able  to  assign  numeri¬ 
cal  values  to  this  change.  The  second  experiment  was  designed  to  measure 
S's  ability  to  derive  quantitative  information  regarding  altitude  from 
the  basic  VCAD.  This  experiment  is  termed  the  absolute  judgment  experi¬ 
ment. 


Since  the  powerfulness  of  altitude  cues  varies  a  great  deal  as  a 
function  of  altitude,  it  was  necessary  to  measure  altitude  judgments  over 
some  specified  range  of  altitudes  in  order  to  insure  generalizabllity  of 


results.  Since  altitude  judgment  accuracy  is  most  critical  at  low 
altitude,  it  was  obviously  necessary  to  measure  judgment  accuracy  at 
low  altitude  levels.  The  decision  as  to  the  upper  limit  of  the  alti¬ 
tude  range  was  based  upon  a  mathematical  analysis  of  altitude  cues 
which  has  been  reported  previously  (Cross,  1968).  This  analysis  was 
concerned  with  the  amount  of  change  in  ground  texture  size  (expressed 
in  terms  of  the  visual  angle  subtended  by  a  ground  texture  element) 
and  in  the  apparent  movement  of  ground  texture  elements  (expressed  in 
terms  of  angular  velocity)  that  results  from  a  given  increment  in 
altitude.  The  results  of  this  analysis  showed  that  once  altitude 
reaches  1000  feet,  the  size  and  the  apparent  velocity  of  ground  tex¬ 
ture  elements  change  very  little  with  further  increases  in  altitude. 

That  is,  these  cues  to  altitude  are  very  insensitive  at  altitudes 
higher  than  1000  feet.  For  these  reasons  the  range  of  altitude 
selected  for  investigation  was  from  10  to  1000  feet. 

Altitude  Maintenance  Experiment 

Subjects 

Four  male  laboratory  personnel  served  as  Ss  in  this  experiment. 

All  of  these  individuals  had  participated  in  at  least  one  previous  VCAD 
experiment,  but  none  had  had  any  prior  experience  in  judging  altitude. 
All  Ss  were  generally  familiar  with  the  manner  in  which  the  display 
changes  as  a  function  of  altitude  change. 

Apparatus 

The  reader  is  referred  to  the  "General  Apparatus"  section  of  this 
report  for  a  discussion  of  the  apparatus  used  in  this  experiment.  The 
following  items  represent  features  not  previously  discussed  which  were 
unique  to  this  experiment. 

1.  The  output  of  the  joystick  was  set-up  to  drive  altitude  rate 
in  the  CADG.  Movement  of  the  stick  to  a  position  forward  of  the  null 
position  introduced  a  negative  rate,  causing  altitude  to  decrease.  A 
stick  position  in  back  of  the  null  position  (toward  S}  introduced  a 
positive  rate,  causing  altitude  to  increase.  The  rate  of  change  of 
altitude  was  a  function  of  the  magnitude  of  the  stick  displacement. 

2.  The  display  sizes  investigated  in  this  experiment  included  a 
5-,  8-,  14- ,  and  17-inch  display. 

3.  During  the  experimental  trials,  altitude  was  continuously 
driven  off  a  standard  altitude  by  a  modulated  sine  wave  forcing  function. 
The  average  frequency  of  this  forcing  function  was  2.0  cpm  and  its 
amplitude  was  +150  feet  (from  the  standard  altitude) . 

4.  Pitch  angle,  roll  angle,  and  heading  angle  remained  at  zero 
degree  throughout  the  experiment.  Longitudinal  ground  speed  was  set 
at  150  knots  with  no  lateral  movement  (drift)  being  introduced. 
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5.  The  equipment  was  modified  to  provide  the  experimenter  with 
the  capability  of  adjusting  altitude  to  any  one  ot  the  live  altitude 
standards  that  were  investigated.  These  five  standards  were  10,  50, 

100,  500,  nr  1AOO  fear.  The  forcing  function  caused  altitude  to  vary 
symmetrically  about  whichever  of  the  standard  altitudes  that  had  been 
set  into  the  equipment.  Altitude  automatically  returned  to  the  atandard 
at  the  termination  of  each  trial. 

6.  The  performance  measures  obtained  included  integrated  error 
(IE),  Integrated  absolute  error  (IAE),  mean  square  error,  and  tlme- 
history  recordings  of  momentary  stick  position,  momentary  altitude, 
and  momentary  altitude  error. 

Procedure 


After  having  been  seated  In  the  fixed-base  cockpit,  Sb  were 
instructed  that  their  task  during  the  experiment  was  to  maintain  alti¬ 
tude  at  a  constant  level  by  appropriately  manipulating  the  joystick  In 
the  longitudinal  axis.  After  being  Informed  of  the  nature  of  the 
display/control  relationship,  Ss  were  invited  to  manipulate  the  stick 
in  order  to  get  e  "feel"  for  its  effect  on  altitude.  All  Sis  ware 
thoroughly  familiar  with  the  VCAD  so  It  was  unnecessary  to  explain 
the  changes  in  the  display  that  rasult  from  altitude  change. 

Prior  to  the  first  trial,  altitude  was  set  to  the  appropriate 
standard,  and  the  S  Instructed  that  "what  he  saw  on  his  display  waa  the 
first  altitude  he  would  be  attempting  to  maintain."  He  was  permitted 
to  examine  the  display  configuration  until  he  reported  feeling  certain 
that  he  could  recall  the  appearance  of  that  standard.  He  waa  also 
Instructed  that  altitude  would  automatically  return  to  the  standard  at 
the  termination  of  each  trial  and  that  he  should  spend  the  time  between 
trials  trying  to  better  learn  the  appearance  of  the  display  when  at  the 
standard  altitude.  Subjects  were  given  unlimited  time  to  study  the 
display  each  time  a  new  standard  was  introduced. 

Performance  was  measured  on  each  of  five  altitude  standards  (10, 

50,  100,  500,  and  1000  feet)  paired  with  each  of  four  size  displays 
(5,  8,  14,  and  17  inch)  giving  a  total  of  20  experimental  conditions. 

All  5  altitude  standards  were  investigated  during  each  dally  session. 

The  order  with  which  these  standards  were  Investigated  during  each  dally 
session  was  established  by  means  of  a  randomization  procedure.  Subjects 
were  given  6  consecutive  two-minute  trials  with  each  of  the  five  altitude 
standards — giving  a  total  of  30  trials  per  day.  In  order  to  provide  a 
better  estimate  of  learning  effects,  the  6  trials  were  divided  into  two 
blocks  of  3  trials  each  for  computational  purposes.  'All  trials  within 
a  dally  session  were  performed  on  the  same  size  display. 

The  order  of  presentation  of  the  four  displays  was  dictated  by  two 
augmented  Latin  Squares.  Table  4  illustrates  the  order  with  which  each 
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Si  received  each  of  Che  four  displays.  Each  ]3  performed  the  experimental 
task  with  each  of  Che  four  displays  on  two  temporally  separate  occasions. 
Moreover,  this  design  insures  that  each  display  size  is  represented 
equally  often  at  each  stage  in  practice.  The  entire  experiment  entailed 
240  two-minute  trials  per  S,,  giving  a  total  of  960  experimental  observa¬ 
tions. 

Results 

The  RMS  and  IE  scores  were  used  to  compute  the  standard  deviation 
of  altitude  error  about  the  mean  of  the  error  distribution  (SDg) .  It 
was  found  that  SDg  and  RMS  were  essentially  equivalent  measures,  their 
correlation  being  .985.  As  was  mentioned  previously  this  finding  indi¬ 
cates  the  absence  of  judgment  bias  and  indicates  that  RMS  error  may  bt 
considered  a  reliable  estimator  of  the  standard  deviation  of  an  error 
distribution  whose  mean  is  zero.  That  is,  tha  mean  of  tha  altltud# 
distribution  is  equivalent  to  the  altitude  standard.  For  this  raaaon, 
the  results  of  the  multiple  regression  analyses  are  presented  for  AAE 
and  RMS  error  only.  The  results  of  these  analyses  ere  summarised  in 
figure  20. 

Figure  20  shows  that  the  regression  aquation  derived  for  AAE  and 
RMS  error  are  composed  of  14  and  23  predictor  variables,  respectively. 
Both  regression  equations  were  found  to  account  for  a  highly  signifi¬ 
cant  proportion  of  the  total  variance  (p  <  .005).  Examination  of  the 
R2  values  will  show  that  both  equations  were  found  to  account  for  an 
unusually  high  proportion  of  the  total  varlance--78  percent  and  75 
percent  for  AAE  and  RMS,  respectively.  These  summary  data  indicate 
that  a  high  degree  of  confidence  can  be  placed  upon  the  predictions 
derived  from  the  regression  equations. 

The  two  Independent  variables  of  primary  interest  in  this  study 
are  display  size  and  altitude  standard.  Figure  20  shows  that  both  were 
selected  as  predictors  of  both  the  performance  measures.  This  finding 
Is  evidence  that  both  variables  influence  the  accuracy  of  altitude 
judgments  as  measured  by  the  altitude  maintenance  task.  Another  pre¬ 
dictor  variable  of  interest  is  the  Display  Size  Standard  interaction 
variable.  Selection  of  this  variable  indicates  that  the  effect  of 
display  size  on  judgment  accuracy  depends  in  part  upon  the  altitude 
standard  being  judged.  The  remaining  predictor  variables,  although  of 
academic  interest,  have  little  bearing  upon  the  main  objective  of  this 
experiment . 

Figure  21  shows  predicted  AAE  (in  volts)  for  the  average  S.  on 
session  7.  Predicted  AAE  is  shown  as  a  function  of  both  display  size 
and  magnitude  of  the  altitude  standard.  (The  break  in  the  ordinate 
of  figure  21  should  be  noted.)  It  is  clear  from  figure  21  that  AAE 
generally  increases  as  a  direct  function  of  magnitude  of  the  altitude 
standard.  Plotting  AAE  against  altitude  standard  on  Semi-Logarithmic 
paper  showed  that  this  relationship  was  only  roughly  logarithmic  in 
nature . 
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Turning  to  the  effect  of  display  size  on  AAE,  it  is  seen  that  inter¬ 
mediate  size  displays  resulted  in  the  least  AAE,  regardless  of  the  magni¬ 
tude  of  the  standard.  The  minimum  point  of  each  of  the  error  curves  is 
identified  in  figure  21.  It  can  be  seen  that  a  12-inch  display  proved 
to  be  optimal  for  all  standards  except  1000  feet,  in  which  case  a  13- 
inch  display  proved  best.  One  other  finding  which  should  be  noted  is 
that  although  a  Display  Size  x  Standard  interaction  term  was  chosen  as 
a  predictor  of  AAE,  the  fact  that  all  the  curves  in  figure  21  appear  to 
be  very  nearly  parallel  indicates  that  the  relative  effect  of  this 
interaction  term  was  quite  small. 

Figure  22  shows  predicted  RMS,  for  the  average  £5  on  session  7,  as 
a  function  of  display  size  and  altitude  standard.  Again,  it  is  seen 
that  error  tends  to  increase  as  a  function  of  the  magnitude  of  the 
standard  and  that  error  is  least  for  intermediate  size  displays.  Yet 
several  distinct  differences  between  the  curves  in  figure  21  and  22  are 
apparent.  The  most  obvious  difference  is  the  overlapping  of  the  curves 
for  the  500-  and  1000-foot  standards.  The  Display  Size  x  Standard  inter¬ 
action  evidentftlly  has  a  more  pronounced  effect  on  RMS  error  than  upon 
AAE.  This  interaction  effect,  however,  appears  to  be  limited  to  the  two 
upper  standards  as  the  remaining  three  curves  appear  to  be  quite  parallel 

to  one  another. 

The  minimum  points  for  the  curves  in  figure  22  are  somewhat  different 
from  the  minimum  points  of  the  corresponding  curves  shown  in  figure  21. 

That  is,  choice  of  the  optimum  display  size  for  minimizing  judgment  error 
depends  upon  whether  judgment  error  is  indexed  by  RMS  error  or  AAE.  The 
optimum  display  size  for  minimizing  AAE  was  12  inches  for  the  lower  four 
standards  and  13  inches  for  the  1000-foot  standard  (see  figure  21). 

Figure  22  shows  that  the  optimum  display  size  for  minimizing  RMS  error 
was  11  inches  for  the  lower  three  standards  and  9  inches  and  8  inches  for 
the  500-  and  1000-foot  standards. 

Another  difference  in  the  findings  for  AAE  and  RMS  error  becomes 
apparent  if  one  considers  the  relative  loss  in  decoding  accuracy  that  can 
be  expected  if  a  non-optimum  display  size  is  used.  Figure  21  shows  that 
this  loss  is  generally  dependent  upon  the  amount  of  divergence  from  the 
optimum  but  that  relatively  smaller  losses  result  from  increasing  display 
size  than  from  decreasing  it.  Figure  22  shows  that  up  to  100-feet  alti¬ 
tude,  increases  and  decreases  of  display  size  from  optimum  result  in 
approximately  equivalent  losses.  However,  at  500  feet  and  above,  con¬ 
siderably  less  loss  results  from  using  display  sizes  smaller  than  optimum. 

The  RMS  error  data  in  figure  22  can  be  used  to  derive  estimates  of 
the  absolute  accuracy  with  which  one  can  expect  an  average  to  maintain 
a  given  altitude.  Examining  judgment  accuracy  for  the  optimum  display 
size,  it  is  seen  that  RMS  error  varies  from  1.1  feet  at  the  10-foot 
standard  to  35.2  at  1000-feet.  Since  RMS  error  is  essentially  an  estimate 
of  the  standard  deviation  of  error  about  the  standard,  one  can  use  the  data 
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71 


to  define  a  range  about  the  standard  within  which  the  average  jS  should 
maintain  altitude  when  attempting  to  maintain  that  standard. 

Discussion 

The  prediction  that  the  ability  to  detect  and  null  deviations  of 
altitude  from  an  assigned  standard  would  increase  as  a  function  of 
display  size  was  not  totally  confirmed  by  the  results  of  this  experi¬ 
ment.  In  an  attempt  to  account  for  the  curious  U-shaped  relationship 
found  to  exist  between  display  size  and  judgment  error,  Ss  were  questioned 
in  detail  as  to  the  cues  which  they  attended  to  for  each  display  size/ 
standard  combination.  Although  the  cues  were  found  to  vary  widely  from 
standard  to  standard,  they  were  found  to  be  constant  across  displays. 

Thus  the  U-shaped  relationship  between  display  size  and  judgment 
accuracy  cannot  be  attributed  to  the  use  of  different  cues  for  different 
displays.  Furthermore,  theoretical  consideration  of  the  types  of  cues 
that  were  utilized  suggested  that  larger  displays  should  be  more  effec¬ 
tive.  Therefore,  it  must  be  stated  that  no  satisfactory  explanation  is 
available  at  this  time  to  explain  the  particular  relationship  found. 

A  prime  purpose  of  this  study  was  to  identify  the  optimum  display 
size  for  the  performance  of  altitude  maintenance.  It  was  found,  however, 
that  what  is  to  be  considered  the  optimum  display  size  depends  not  only 
upon  the  magnitude  of  the  altitude  standard  but  also  upon  whether  AAE  or 
RMS  error  is  selected  as  the  criterion  of  proficiency.  It  is  therefore 
necessary  to  consider  the  relative  importance  of  judgment  accuracy  at 
various  altitudes  and  to  consider  the  relative  merits  of  AAE  and  RMS  as 
indices  of  proficiency  before  a  final  recommendation  can  be  made. 

The  first  problem  is  simple.  Judgment  accuracy  is  obviously  most 
critical  at  low  altitudes  so,  other  things  being  equal,  it  seems  reason¬ 
able  to  recommend  the  display  size  that  proves  most  effective  at  the  low¬ 
est  altitude. 

Some  insight  into  the  relative  merits  of  AAE  and  RMS  error  as  indices 
of  proficiency  can  be  gained  if  one  considers  the  manner  in  which  they 
are  derived.  If  it  is  considered  that  AAE  is  based  upon  the  integral  of 
absolute  error  and  RMS  error  is  based  upon  the  integral  of  squared  error, 
it  is  clear  that  RMS  error  would  tend  to  weight  extreme  deviations  rela¬ 
tively  more  heavily  than  AAE.  Considering  the  negative  pay-off  associated 
with  extreme  deviations  of  altitude  from  the  standard,  this  attribute  of 
RMS  error  would  appear  to  be  highly  desirable.  On  the  basis  of  the  data 
obtained  in  this  experiment  and  the  rationale  presented  above,  11  inches 
Is  recommended  as  the  optimum  size  display  for  altitude  maintenance. 

Absolute  Judgment  of  Altitude 

The  purpose  of  this  experiment  was  to  obtain  estimates  of  the  accuracy 
with  which  the  magnitude  of  altitude  can  be  judged  with  the  basic  VCAD,  and 
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to  determine  whether  altitude  judgment  accuracy  varies  am  a  function 
of  display  size. 

Subjecta 

Eight  laboratory  personnel  served  aa  £s  in  this  experiment,  four 
Ss  were  totally  familiar  with  the  VCAD,  having  had  served  as  Ss  in  two 
previous  experiments—ineludlng  the  altitude  maintenance  experiment. 

The  remaining  4  Sa  were  selected  on  the  basis  of  having  had  no  prior 
experience  with  the  VCAD  whatsoever. 

Apparatus 

With  two  exceptions,  the  apparatus  used  in  this  experiment  was 
identical  to  that  used  in  the  altitude  maintenance  experiment.  Unlike 
the  altitude  maintenance  study,  no  forcing  function  was  introduced  into 
the  altitude  channel  in  the  present  experiment.  Also,  the  CADC  was 
modified  to  provide  a  numerical  read-out  of  altitude  (in  feet)  in  the 
upper  right-hand  comer  of  the  display.  The  experimenter  wee  provided 
a  switch  with  which  to  turn  these  numerics  off  or  on  at  will. 

Procedure 

Before  beginning  the  experiment  Sa  were  lnatructad  that  their  teak 
would  be  to  sequentially  aat  tha  diaplay  at  ona  of  a  number  of  preecrlbed 
altitudes  by  appropriately  manlpulstlng  tha  joyatlck.  Subjacts  were 
then  given  the  opportunity  to  manipulate  the  stick  and  observe  the  result¬ 
ing  changes  in  the  display.  After  Sa  reported  that  they  had  gotten  the 
"feel"  of  the  control,  they  vers  told  that  they  would  be  shown  each  of 
the  altitude  standards  and  that  they  should  try  to  remember  tha  appearance 
of  the  display  when  at  each  of  theae  altitude  standards.  Altitude  wee 
then  sequentially  eat  at  10-,  15-,  20-,  30-,  40-,  50-,  70- ,  100-,  250-, 
500- ,  750- ,  end  1000-feet,  allowing  £  to  view  each  standard  for  a  parlod 
of  30  seconds.  Subjects  wsrs  told  that  on  the  first  day  of  their  partici¬ 
pation  they  would  not  be  informed  of  how  accurate  their  settings  wsrs,  but 
that  on  subsequent  days  numerics  would  tppsar  on  ths  display— immsdietely 
after  each  setting — which  would  inform  them  of  the  actual  altitude  of 
their  setting.  They  were  instructed  to  attend  carefully  to  this  feedback 
information  in  order  to  improve  the  accuracy  of  subsequent  settings. 

At  the  beginning  of  each  trial  the  experimenter  verbally  informed 
S.  of  the  standard  at  which  he  wee  to  set  altitude,  e.g.,  "...  your  next 
standard  is  750  feet."  After  £  had  signaled  completion  of  hie  setting, 
the  experimenter  placed  the  CADG  in  a  "hold"  condition  which  locked  alti¬ 
tude  at  its  current  level,  threw  the  switch  which  activated  the  altitude 
numerics,  and  recorded  the  altitude  of  the  setting  from  the  experimenter's 
display  monitor.  During  the  "no  feedback"  trials  Ss  were  instructed  to 
look  away  during  the  period  that  the  numerics  were  presented;  thereafter, 
Sa  were  instructed  to  attend  to  the  numerics  and  the?  display  configuration 
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during  the  inter-trial  interval  which  laated  for  approximately  30 
•econda . 

Twelve  altitude  standards  and  four  display  sizes  were  investigated, 
giving  a  total  of  48  experimental  conditions.  In  addition,  Ss  were 
tested  on  one  no-feedback  session  prior  to  the  experiment  proper  in 
order  to  clearly  establish  the  initial  level  of  skill  prior  to  any 
learning. 

Two  settings  were  made  for  each  altitude  standard  during  each 
dally  season.  The  altitude  standards  were  presented  in  random  order 
with  the  limitation  that  the  same  standard  could  not  bo  presented  on 
two  successive  trials.  All  trials  within  a  dally  session  were  performed 
on  the  sane  alee  display. 

The  order  of  presentation  of  the  4  displays  is  illustrated  in  table 
S,  This  design  will  ba  rccognlzad  as  being  composed  of  two  augmented 
Latin  Squares i  the  characteristics  of  which  were  discussed  in  the 
"Procedures"  section  of  the  previous  experiment.  The  rows  adjacent  to 
the  .S  number  identifies  the  order  with  which  that  |5  received  the  4  dis¬ 
play  sixes.  Subjects  1,  2,  3,  and  4  represent  the  experienced  population 
and  Ss  5,  6,  7,  and  8  were  non-experienced .  Although  all  4  display  sizes 
ware  represented  in  the  no-feedback  condition  (session  zero) ,  It  should 
be  noted  that  the  Display  Size  variable  is  confounded  with  the  Subjects 
variable.  Because  the  only  objective  of  session  zero  was  to  obtain  a 
valid  satlmate  of  the  Initial  level  of  skill,  independent  of  display 
size,  this  confounding  was  considered  unimportant. 

Results 


Two  performance  measures  were  computed  from  the  raw  data,  vis.,  AAK 
and  AE.  The  results  of  the  multiple  regression  analysis  performed  on 
these  two  maasuras  are  summarized  in  figure  23.  Examination  of  the 
predicted  AE  data,  an  index  of  judgment  bias,  showed  that  judgment  biases 
occurred  early  in  training  and  were  specific  to  individual  Sa  rather  than 
being  consistent  across  Ss.  But  by  the  end  of  training  these  response 
biases  had  essentially  disappeared.  Since  jS  specific  response  biases  which 
occur  only  early  in  learning  hold  no  particular  interest,  AE  will  not  be 
discussed  further  and  the  reader  may  consider  judgment  errors  to  be  symmet¬ 
rically  distributed  about  the  standard  by  the  end  of  training. 

Figure  23  shows  that  a  total  of  24  terms  were  selected  for  the  AAE 
prediction  equation.  An  F- ratio  of  22.2  shows  that  a  statistically  sig¬ 
nificant  proportion  of  the  total  variance  is  accounted  for  by  the  regres¬ 
sion  equation  (23-percent  as  per  R2). 

As  has  been  true  previously,  the  variable  of  primary  interest  in  this 
experiment  was  Display  Size.  Figure  23  shows  that  Display  Size  was  not 
selected  by  the  regression  analysis  as  contributing  to  the  predictable 
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variance,  a  finding  which  indicates  that  display  size  had  no  overall 
effect  on  altitude  judgment  accuracy.  However,  the  finding  that  a 
Display  Size  x  Standard  interaction  term  was  selected  by  the  analysis 
indicates  that  display  size  did  have  some  slight  effect  on  judgment 
accuracy  but  that  this  effect  varied  as  a  function  of  the  altitude  stand¬ 
ard.  Two  other  variables,  whose  selection  represents  no  surprise,  are 
Standard  and  Experience.  Although  it  appears  obvious  that  altitude 
Judgments  would  vary  as  a  function  of  the  magnitude  of  the  altitude 
standard  and  the  amount  of  £'s  prior  experience  with  the  VCAD,  It  was 
of  interest  to  determine  the  relative  magnitude  of  these  effects. 

The  nature  of  the  effects  of  the  variables  of  primary  interest  is 
shown  in  figures  24  and  25.  Thaaa  figures  show  AAE  as  a  function  of 
display  size  and  magnitude  of  the  altitude  standard.  The  curves  rep¬ 
resent  predictions  for  the  average  inexperienced  8  (figure  24)  and  the 
average  experienced  .S  (figure  25)  on  session  7.  Both  curves  are  drawn 
to  approximately  the  same  scale  in  order  to  facilitate  comparison. 

Comparison  of  figures  24  snd  25  will  show  thst  altitude  judgment 
error  was  clearly  greater  for  the  inexperienced  S.  Better  than  a  three¬ 
fold  difference  in  error  magnitude  is  noted  for  most  altitude  standards. 
Dlsplte  the  large  difference  in  the  magnitude  of  judgment  error,  it  can 
be  seen  that  the  relationship  among  the  various  curves  within  the  two 
figures  is  highly  similar.  For  example,  rank  ordering  the  altitude 
standards  on  the  basis  of  error  shows  that  the  same  ranking  la  obtained 
for  both  S.  populations  with  one  exception.  The  ranking  of  the  50-  and 
500-foot  standards  for  the  inexperienced  Ss  is  reversed  from  that  found 
for  experienced  Ss. 

Of  considerably  more  interest  is  the  finding  that  judgment  error  is 
not  a  simple  increasing  function  of  the  magnitude  of  the  altitude  standard. 
The  discrepancies  from  expectation  occur  at  the  50- ,  250- ,  and  750-foot 
standards.  These  differences  in  the  relative  difficulty  of  the  various 
altitude  standards  were  found  to  be  a  function  of  the  types  of  altitude 
cues  utilized  by  the  Ss.  This  topic  will  be  given  further  consideration 
In  the  Discussion  section. 

The  effect  of  the  Display  Size  x  Standard  interaction  term  is  apparent 
in  both  figures  24  and  25.  It  is  seen  that  when  judging  lower  altitudes, 
display  size  has  essentially  no  effect  on  judgment  accuracy.  However,  at 
altitudes  above  250  feet,  judgment  accuracy  tends  to  increase  as  a  function 
of  display  size,  and  the  magnitude  of  this  effect  tends  to  increase  as  a 
function  of  altitude. 

Referencing  the  scale  on  the  right-hand  ordinate  of  figures  24  and  25 
will  enable  the  reader  to  interpret  the  various  curves  in  terms  of  the 
standard  deviation  of  error  about  the  altitude  standard.  As  was  illustrated 
in  the  discussion  of  previous  experiments,  these  data  can  be  used  to  define 
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a  range  about  the  standard  within  which  a  proportion  of  the  average  S's 
judgments  could  be  expected  to  fall.  The  width  of  this  range  depends, 
of  course,  upon  the  proportion  of  the  population  of  judgments  one  desires 
to  encompass  within  the  range. 

Discus on 

The  lack  of  an  overall  effect  of  display  size  on  decoding  accuracy 
ia  in  accord  with  prior  predictions,  although  the  finding  of  a  Display 
Site  x  Standard  interaction  was  unexpected.  It  was  originally  assumed 
that  the  accuracy  of  altitude  judgments  would  be  a  function  of  (a)  the 
absolute  amount  of  change  In  the  altitude  cues  that  results  from  an 
Increment  in  altitude — the  "sensitivity"  of  cues  to  changes  in  altitude 
being  greater  for  larger  displays  and  (b)  .S's  ability  to  remember  the 
location  of  the  standard.  Although  consideration  of  the  sensitivity 
of  the  various  cues  to  changes  in  altitude  would  suggest  that  more 
accurate  judgments  would  be  made  with  larger  displays,  it  was  predicted 
that  the  amount  of  variability  due  to  Inaccuracy  in  recalling  the  posi¬ 
tion  of  tha  standard  would  be  so  large  that  the  effects  of  display  size 
feald  be  totally  masked.  If  these  assumptions  are  valid,  the  findlnga 
of  this  experiment  suggest  that  the  altitude  standards  can  be  more 
accurately  recalled  and  reproduced  than  was  originally  supposed.  Con- 
slderetlon  of  the  absolute  accuracy  with  which  the  altitude  settings 
Wire  made  tends  to  support  this  conclusion. 

A  difference  between  the  judgment  accuracy  of  experienced  and 
Inexperienced  Sa  was  expected  but  the  size  of  this  difference— even 
after  7  training  sessions— was  surprising.  The  experienced  S,  had  been 
exposed  to  only  the  10- ,  50- ,  100- ,  500- ,  and  1000-foot  standards  during 
thl  altitude  maintenance  experiment  and  they  were  not  specifically 
instructed  to  learn  to  associate  quantitative  values  with  these  standards. 
Moreover,  thalr  initial  proficiency  showed  that  they  had  not  done  so. 

Tha  probable  cause  of  their  superior  performance  was  that  their  prior 
experience  provided  them  the  opportunity  to  identify  a  larger  number  of 
prospectively  useful  altitude  cues  and  to  differentiate  those  that  were 
most  ustful.  This  knowledge,  in  turn,  enabled  the  experienced  £  to 
better  utilize  the  feedback  Information. 

Examination  of  the  possible  causes  of  the  differences  in  judgment 
error  for  the  various  altitude  standards  revealed  several  interesting 
facts  regarding  the  utilization  of  altitude  cues.  It  was  found  that  at 
altitudes  of  40-feet  and  below,  no  texture  breakpoint  was  available  on 
the  display.  At  these  altitudes  Sa  reported  using  either  size  of  ground 
texture  or  the  angle  of  convergence  of  perspective  lines  as  cues  to  alti¬ 
tude.  Tha  data  in  figures  24  and  25  Indicate  that  these  were  effective 
cues  at  thaaa  altitudes. 

Tha  first  order  breakpoint  first  began  to  emerge  clearly  at  an 
altitude  of  50  feat  and  waa  visible  up  through  750  feet  altitude.  Most 


Sa  rannft*d  thji  bjtvccr.  50  -  $Su  750  icvi  aliiiuae  they  referenced  Che 
position  of  ths  texture  breakpoint  relative  to  either  the  horlaon  line 
ur  the  bottom  edge  of  the  display  in  salting  their  judgments.  If  It  is 
not  i*  that  at  low  altitudes  the  position  of  the  breakpoint  changes  very 
little  as  a  function  of  altitude,  it  follows  that  breakpoint  position  la 
not  a  sensitive  cue  to  altitude  at  very  low  altitudes •  The  disproportion* 
etely  large  error  associated  with  the  50-  and  70-foot  standards  suggests 
that  it  was  a  mistake  for  £  to  use  breakpoint  position  as  a  cue  at  these 
altitudes.  Judgrturt  error  at  these  altitudes  would  probably  be  consider¬ 
ably  reduced  if  Ss  were  instructed  to  attend  to  either  sise  of  ground 
texture  or  convergence  of  perspective  lines  as  their  cues  to  altitude. 

Another  Interesting  finding  was  that  Judgment  error  tended  to  be 
s  function  of  the  proxlnlty  of  the  breakpoint  to  the  botton  adga  of 
the  screen.  For  exanple,  at  250-faet  altitude,  the  breakpoint  was 
located  about  two-fifths  of  the  distance  between  the  horizon  line  and 
the  botton  edge  of  the  screen.  Judgnent  errors  were  vary  lnrgs  under 
this  condition.  At  500-faet  altitude,  the  breakpoint  wee  located  approxi¬ 
mately  seven-tenths  of  the  distance  between  the  horison  line  and  the 
botton  edge  of  the  display  and  error  was  found  to  be  even  less  then  at 
250  feet.  This  finding  suggests  that  judgnent  accuracy  would  probably 
improve  if  a  aupplenentary  rsference  nark  wars  positioned  about  half 
the  distance  between  the  horlcon  line  end  the  botton  edge  of  the  dis- 
play. 

PITCH  ANCLE  EXPERIMENTS 

In  an  earlier  discussion  it  was  pointed  out  that  the  amount  of 
change  in  the  position  of  the  horison  line  that  results  from  an  increment 
in  pitch  angle  is  •  function  of  not  only  pitch  angle,  but  display  else 
and  display  viewing  angle  as  well.  The  relationship  anong  these  variables 
was  illustrated  in  figure  5.  It  is  shown  in  figure  5  that  when  display 
viewing  angle  is  manipulated  so  as  to  maintain  a  1:1  correspondence  between 
the  display  and  the  real  world,  the  amount  of  change  in  the  position  of 
the  horizon  line  that  results  from  a  given  increment  in  pitch  angla  is 
the  tone,  regardless  of  the  size  of  display  being  used.  Conversely,  If 
display  viewing  angle  is  held  constant  while  display  size  is  varied,  the 
amount  of  horizon  line  displacement  per  pitch  increment  Increases  as  a 
direct  function  of  display  size.  It  can  thus  be  seen  that  larger  displays 
provide  a  more  sensitive  index  of  change  in  pitch  angle  then  smaller 
displays  -  assuming  display  viewing  angle  remains  constant.  However, 
Increasing  display  size  also  makes  the  display  less  "real-world  like" 
so  far  as  pitch  angle  is  concerned.  The  larger  the  display  the  less  the 
displacement  of  the  displayed  horison  line  corresponds  with  the  displace¬ 
ment  of  the  "real-world"  horizon  line,  given  a  fixed  pitch  increment. 
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This  fact  necessitates  the  modification  of  research  objectives  from 
those  described  for  the  roll  angle  and  altitude  experiments.  Previously, 
the  influcence  of  display  size  on  both  standard  maintenance  and  absolute 
judgment  tasks  was  investigated.  Although  measuring  a  S' s  ability  to 
maintain  a  given  standard  pitch  angle  as  a  function  of  display  size  is 
a  legitimate  procedure,  once  a  jS  is  asked  to  ascribe  numerical  values 
to  a  given  pitch  angle  (absolute  judgment)  the  task  becomes  impossibly 
confusing.  If  a  S  were  to  judge  the  position  of  the  horizon  line  accord¬ 
ing  to  a  "real-world'*  criterion,  his  error  would  automatically  increase 
as  a  function  of  display  size.  If  a  S  were  asked  to  judge  roll  angle 
according  to  the  CADG  read-out,  he  would  be  asked  to  learn  a  totally 
different  scale  for  each  display  size  and  hi.s  proficiency  would  be 
inversely  related  to  his  ability  to  ascribe  numerical  values  to  "real- 
world"  pitch  angles.  Either  way,  measuring  absolute  pitch  angle 
judgments  as  a  function  of  display  size  would  produce  totally  meaning¬ 
less  results. 

The  objective  of  the  first  experiment  reported  in  this  section  was 
to  define  the  nature  of  the  relationship  between  display  size  and  accuracy 
with  which  a  standard  pitch  angle  can  be  maintained,  and  to  obtain  a 
reliable  estimate  of  the  accuracy  with  which  the  maintenance  task  can 
be  performed.  The  objective  of  the  second  experiment  was  to  obtain  a 
reliable  estimate  of  absolute  roll  angle  judgment  accuracy  for  a  single 
display  size. 

Pitch  Angle  Maintenance 

Subjects 


Four  laboratory  personnel  served  as  Ss  in  this  experiment.  The  J>s 
had  neither  previous  flight  experience  nor  previous  experience  with  the 
VCAD. 


Apparatus 

With  the  exception  of  the  following  features  the  apparatus  was  the 
same  as  that  described  in  the  "General  Apparatus"  section  of  this  report. 

1.  Four  display  sizes  were  available  for  investigation  (5,  8,  14, 
and  17  inches) . 

2.  Sine  wave  forcing  functions  were  introduced  into  both  the  pitch 
and  roll  channels.  The  frequency  and  amplitude  of  the  forcing  function 
introduced  into  the  pitch  channel  were  2.6  cpm  and  +15  degrees.  This 
forcing  function  caused  pitch  angle  to  vary  symmetrically  about  whichever 
pitch  angle  standard  was  in  use  at  the  time  the  forcing  function  was 
introduced.  The  forcing  function  introduced  into  the  roll  channel  had  a 
frequency  of  2.0  cpm  and  an  amplitude  of  +12  degrees.  Roll  angle  varied 
about  zero  degrees  throughout  the  experiment. 
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2.  The  G  maa  piuviuwu  i'ne  capability  ot  nulling  error  in  roll  angle 
by  feeding  the  joystick  output  into  the  pitch  channel.  Displacement  of 
the  stick  forward  of  the  null  position  Introduced  a  negative  rate  caus¬ 
ing  the  siaulated  aircraft  to  pitch  down.  Displacement  in  the  opposite 
direction  introduced  a  positive  rate  causing  the  siaulated  aircraft  to 
pitch  up.  No  control  of  roll  angle  was  provided. 

4.  Circuitry  was  developed  to  enable  the  experimenter  to  set 
pitch  angle  at  plus  or  minus  75,  45,  30,  15,  or  0  degrees  by  manipulating 
a  potentiometer  located  on  the  analog  computer.  These  nine  conditions 
represented  the  roll  angle  standards  investigated.  Also,  the  equipment 
was  configured  such  that  pitch  angle  would  automatically  return  to  the 
standard  pitch  angle  at  the  termination  of  each  trial. 

5.  The  performance  measures  obtained  included  integrated  absolute 
error.  Integrated  error  squared,  and  Integrated  error  with  respect  to 
sign. 

6.  Altitude  wss  held  constant  at  500  feet  and  forward  ground 
velocity  waa  maintained  at  150  knota.  Mo  lateral  movement  wae  introduced. 

Procedure 

Prior  to  the  flrat  experimental  trials,  ge  were  Instructed  that  their 
task  was  to  maintain  an  aaelgnad  pitch  angle  Throughout  a  two-minute  trial 
by  manipulating  the  control-stick  in  the  longitudinal  plane.  Subjects 
were  then  allowed  to  manipulate  the  control  in  order  to  become  familiar 
with  its  dynamics  and  with  the  display/control  relationship.  Before 
performing  on  each  of  the  standards,  Ss  were  permitted  to  view  the 
standard  until  they  felt  sure  they  could  recognise  its  appearance. 
Thereafter,  Ss  wsre  instructed  to  devote  the  inter-trial  Interval 
attempting  to  better  learn  the  appearance  of  the  standard.  Subjects  were 
given  verbal  signals  to  indicate  the  start  and  the  termination  of  tech 
trial. 

Each  of  the  nine  roll  angle  standards  were  paired  with  each  of  the 
four  displays,  giving  a  total  of  36  experimental  conditions.  Subjects 
were  given  three  consecutive  two-minute  trials  per  daily  session  on  each 
of  the  roll  angle  standards  except  for  the  sero-degree  standard  in  which 
case  they  were  given  two  temporally  separate  seta  of  three  trials  each. 

All  the  30  trials  withlu  a  daily  session  were  performed  on  the  same  else 
display. 


The  nine  roll  angle  standards  were  randomized  within  sessions.  The 
order  with  which  each  £  received  the  different  display  sizes  was  estab¬ 
lished  by  using  augmented  Latin  Squares  as  shown  in  table  6.  The  features 
of  this  design  were  discussed  in  conjunction  with  previous  experiments. 


Results 


The  three  performance  measures  computed  from  the  raw  date  were  AAE, 

RMS  error,  end  the  standard  deviation  about  the  mean  of  the  error  dis¬ 
tribution.  The  latter  two  of  these  measures  were  found  to  be  very  highly 
correlated  (r  ■  .998).  As  was  discussed  previously,  this  finding  indicates 
that  the  mean  of  the  error  distribution  is  zero  (no  Judgment  bias)  and 
that  errors  must  therefore  be  symmetrically  distributed  about  the  pitch 
angle  standard.  Since  both  measures  are  essentially  identical,  only 
RMS  was  submitted  to  analysis. 

The  results  of  the  multiple  regression  analyses  for  AAE  and  RMS  error 
are  summarized  In  figure  26.  It  is  seen  that  a  total  of  19  predictor 
variables  ware  chosen  for  each  measure.  The  composite  of  these  predictor 
variables  was  found  to  account  for  a  highly  significant  proportion  of  tha 
total  variance.  The  proportion  of  the  to£a£  variance  accounted  for  by 
the  regression  equation  (as  indieatad  by  R  ;  can  be  seen  to  be  73  percent 
and  72  percent  for  AAE  and  RMS,  respectively. 

Six  different  seta  of  predictor  variables  ware  chosen  by  tha  mul¬ 
tiple  regression  analysis.  Of  these  tha  Display  Sima  variable  and  tha 
Standards  variable  hold  the  most  Interest.  The  effects  of  thass  vari¬ 
ables  are  discussed  in  the  following  pages. 

Figure  27  shows  the  relationship  between  AAE  (in  volts)  and  dis¬ 
play  size.  These  data  represent  predictions  for  tha  average  £ 
maintaining  the  zero-degree  standard  on  session  7.  Since  there  wee 
no  interaction  between  display  size  and  standard,  tha  shape  of  this 
curve  (but  not  the  magnitude  of  error)  can  be  considered  representative 
for  all  standards.  It  can  be  seen  that  AAE  wee  found  to  be  laaat  for 
intermediate  size  displays.  Tha  minimum  point  on  this  curve  wee  found 
to  correspond  with  a  12. 25-inch  display. 

RMS  error  is  shown  in  figure  28  as  a  function  of  display  else  end 
magnitude  of  tha  pitch  angle  standard.  Bacauaa  of  tha  close  proximity 
of  the  curves  for  tha  various  display  sizes,  only  tha  curves  for  ths 
worst  and  the  beat  cases  are  shown.  Ths  curvs  for  the  5-inch  display 
represents  the  worst  case  and  tha  curve  for  tha  12.25-lnch  display,  tha 
beat.  The  curves  for  all  other  display  sizes  fall  within  thase  bounds. 

The  moat  striking  effect  in  figure  28  la  the  finding  that  the  minus 
75-degree  standard  was  clearly  more  difficult  than  the  remaining 
standards.  Tha  probable  reason  for  this  finding  will  be  discussed  in 
the  following  section.  Otherwise,  there  appears  -to  be  little  difference 
In  RMS  error  among  the  remaining  standards.  Of  considerable  Interest 
is  the  absolute  magnitude  of  the  RMS  error  for  the  various  standards. 
Considering  the  12.25-inch  display,  RMS  error  is  seen  to  be  lees  then 
one  degree  for  all  standards  except  tha  negative  75-degree  standard. 
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Flgura  27.  Avaraga  Abkeluta  I 
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Since  RMS  error  Is  en  estimate  of  the  standard  deviation  of  error  about 
the  standard,  it  can  be  stated  with  a  high  degree  of  confidence  that  the 
average  S  could  maintain  pitch  angle  to  within  3  degrees  of  an y  pitch 
angle  standard  (from  negative  45  to  positive  75  degrees)  a  very  high 
proportion  of  the  tine. 

Discussion 


The  prediction  that  the  accuracy  of  pitch  angle  maintenance  would 
increase  as  a  function  of  display  size  was  only  partially  confirmed  by 
these  data.  Again,  no  good  explanation  is  available  at  this  time  to 
account  for  the  curious  "U"  shaped  relationship  between  maintenance 
judgment  accuracy  and  display  size.  Although  the  effect  of  display 
size  was  significant  from  s  statistical  view,  display  else  over  the 
range  investigated  has  little  practical  Import.  The  largest  SMS  error 
difference  between  the  worst  and  the  optimum  display  was  only  about 
10-mlnutes  of  arc. 

The  relative  difficulty  of  the  negative  75  degree  standard  was 
found  to  be  a  function  of  the  ineffective  pitch  angle  cues  available 
at  that  condition.  It  was  found  that  either  the  horizon  line  or  e 
breakpoint  line  was  visible  for  all  standards  except  positive  and 
negative  75  degrees.  In  the  case  of  e  positive  75  degree  standard,  sky 
texture  elements  end  the  Zenith  Marker  were  visible  and  provided  stable 
references  for  pitch.  When  pitched  down  75  degress,  neither  the  horizon 
line  or  a  breakpoint  line  could  be  seen,  thus  forcing  Sa  to  reference  the 
angle  of  convergence  of  perspective  lines  in  judging  pitch.  The  magnitude 
of  the  error  associated  with  this  condition  makes  it  apparent  that  per¬ 
spective  lines  do  not  provide  an  effective  cue  for  pitch  angle.  In 
comparing  the  magnitude  of  error  for  each  of  the  pitch  angle  standards 
with  the  strategies  used,  it  was  generally  found  that  error  wee  inversely 
related  to  the  proximity  of  e  stable  reference  (horizon  line,  breakpoint 
line,  sky  texture  elements,  Zenith  Marker)  to  the  upper  or  lower  edge 
of  the  display. 

Absolute  Pitch  Angle  Judgments 

The  objective  of  the  present  experiment  was  to  obtain  a  reliable 
estimate  of  the  accuracy  with  which  a  S  can  be  expected  to  judge  the 
absolute  magnitude  of  pitch  angle.  Because  of  the  accuracy  with  which 
£s  were  able  to  maintain  the  various  pitch  angles  in  the  previous  experi¬ 
ments  and  because  some  of  the  cues  utilized  would  not  be  available  In  a 
flight  situation,  it  was  decided  to  measure  absolute  pitch  angle  judg¬ 
ments  under  conditions  which  provided  a  j5  with  fewer  stable  cues.  The 
introduction  of  forcing  functions  in  the  roll  and  the  altitude  channels 
forced  a  S  to  abandon  some  of  his  "alignment"  cues  and  to  depend  more 
upon  his  memory  of  the  appearance  of  a  condition  than  upon  his  ability 
to  align  some  stable  features  of  the  display  with  the  edge  of  the 
display.  At  negative  pitch  angles  Ss  are  forced  to  use  angle  of 
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,CC3Vtrgtnce  of  perspective  lines  as  cues  and  since  the  sensitivity  of 
^■_iph||l»u4sass^ «•  a  function  of  altitude  It  was  also  of  interest  to 
...  dptenilne  the  effect  of  altitude  on  the  accuracy  of  judging  large 
r  negative  pitch  angles.  Since  the  aky  plane  is  always  seen  at  a  constant 
4iet*&CS* changing  altitude  could  have  no  effect  on  the  judgment  of 
large  positive  pitch  angles. 

Subjects 

Three  laboratory  personnel  were  used  as  £s  in  this  experiment.  All 
three  £s  had  served  previously  in  an  experiment  concerned  with  absolute 
.pitch  angle  judgments.  That  experiment  was  scrapped  because  the  cues 
utilised  were  not  considered  representative  of  those  available  in  a  flight 
Situation.  All  £a  can  therefore  be  considered  highly  trained  upon  par¬ 
ticipating  in  thla  experiment. 

The  apparatus  used  in  the  pitch  angle  maintenance  experiment  was 
modified  only  slightly  for  use  in  the  present  experiment.  As  mentioned 
previously,  forcing  functions  were  introduced  into  both  the  roll  and 
-the  altitude  channels.  Altitude  Was  driven  off  its  initial  level  by 
+50  feet  and  roll  angla  traveled  through  an  excusion  of  +6  degrees  about 
sero.  Tha  frequency  of  the  forcing  functions  was  2.0  cpm  for  altitude 
and  2.3  cpm  for  roll  angle.  A  direct  read-out  of  momentary  pitch  angle 
in  degrees  Warn  provided  on  a  digital  voltmeter  located  on  the  analog 
computer.  An  8-inch  display  was  used  throughout  the  experiment. 

Procedure 

Nineteen  pitch  angle  standards,  varying  from  negative  90  degrees 
to  posltivs  90  dsgraes  in  10-degree  Increments,  were  investigated.  The 
accuracy  with  which  each  of  these  standards  could  be  judged  was  measured 
at  each  of  three  altitudes  (100,  500,  and  1000  feet).  Each  of  the 
standards  were  judged  once  during  a  daily  session.  The  order  of  pre¬ 
sentation  of  the  standards  was  randomized  within  sessions  and  all 
judgments  within  a  session  were  performed  at  the  same  altitude.  Altitude 
was  counterbalanced  across  sasaiona  as  shown  in  table  7.  Thla  design 
ensures  that  each  £  receives  each  altitude  with  equal  frequency,  that 
tha  altitudes  are  presented  in  all  possible  orders,  and  that  each  altitude 
is  represented  at  each  stage  in  practice. 

The  experimental  procedures  were  the  same  as  used  in  the  absolute 
altitude  and  abaolute  roll  angle  judgment  experiments  and  will  not  be 
repeated  here.  Because  all  Ss  had  participated  in  a  prior  experiment 
concerned  with  abaolute  pitch  angle  judgments  It  wee  unnecessary  to 
re-lndoctrlnate  them  regarding  tha  procedures.  Feedback  was  given 
Inmedlately  after  each  judgment  by  verbally  informing  the  £  of  the  actual 
magnitude  of  hla  setting  in  degrees. 
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Results 


The  results  of  the  multiple  regression  analyses  of  AAE  and  AE  are 
summarized  in  figure  29.  A  total  of  30  predictor  variables  were  selected 
for  AAE  and  21  for  AE.  A  statistically  significant  proporation  of  the 
total  variance  was  accounted  for  by  both  regression  equations  (Note  the 
F-ratioc  and  the  TP  values).  This  study  was  designed  to  investigate  the 
effects  of  both  pitch  angle  standard  and  altitude  on  absolute  judgment 
accuracy.  Although  only  the  former  was  selected  by  the  regression 
analysis,  it  will  be  noted  that  a  Standard  X  Aliitude  interaction  vari¬ 
able  was  selected  indicating  that  altitude  was  not  entirely  without 
effect. 

The  nature  of  the  effects  of  these  two  variables  is  illustrated 
in  figure  30  and  31.  Figure  30  shows  AAE  as  a  function  of  magnitude  of 
altitude  and  pitch  angle  standard.  Different  altitude , curves  are  not 
shown  for  positive  pitch  angles  because  the  display  configuration  was 
essentially  independent  of  altitude  at  these  angles.  It  can  be  seen 
that  AAE  was  found  to  be  relatively  stable  over  the  range  between  nega¬ 
tive  40-degrees  and  positive  90-degrees  pitch  angle.  As  pitch  angle  is 
decreased  below  negative  40-degrees,  AAE  tends  to  first  increase  and 
then  decrease  at  negative  90-degrees.  Although  the  accuracy  of  pitch 
angle  judgments  clearly  varies  as  a  function  of  altitude,  the  relation-  - 
ship  is  in  no  way  systematic. 

Before  the  meaning  of  the  AAE -scores  is  discussed  further,  attention 
will  be  turned  to  figure  31  which  shows  AE  as  a  function  of  magnitude 
of  altitude  and  pitch  angle  standard,  remembering  that  AE  is  an  index 
of  judgment  bias.  Figure  31  shows  that  sizable  judgment  biases  were 
present  at  certain  standards,  and  for  certain  altitudes.  The  largest 
biased  occurred  at  the  negative  90  degree  standard  when  judging  from  an 
altitude  of  1000  feet.  This  AE  socre  Indicates  that,  on  the  average, 
a  jS  tended  to  adjust  pitch  to  an  angle  about  10  degrees  less  than  the 
standard  when  attempting  to  set  pitch  angle  to  negative  80  degrees. 

Other  deviations  from  the  zero  line  are  Interpreted  similarly. 

The  important  effect  of  these  judgment  biases  is  to  limit  the 
interpretation  that  can  be  placed  on  AAE.  Previously,  when  it  was  found 
that  errors  were  distributed  symmetrically  about  the  standard,  one  could 
take  advantage  of  the  equality,  SD  1.5  (AAE),  in  making  statements 
about  the  judgment  accuracy  that  would  be  expected  from  the  a\erage  JS. 
However,  this  quantity  is  not  a  reliable  estimate  of  the  standard  devi¬ 
ation  of  error  about  the  standard  when  symmetry  of  error  about  the 
standard  does  not  exist. 

Discussion 


Few  general  statements  can  be  made  regarding  the  effect  of  magnitude 
of  the  pitch  angle  standard  and  altitude  on  the  accuracy  of  pitch  angle 
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judgment*.  Although  both  altitude  ana  standara  street  tne  accuracy  ot 
Judging  negative  pitch  angles,  this  effect  does  not  appear  to  occur  in 
any  predictable  way. 

In  using  these  data  to  make  predictions  as  to  expected  judgment 
accuracy,  it  is  necessary  to  exercise  considerable  caution  due  to  the 
presence  of  eiseble  judgment  biases.  However,  simultaneous  reference  to 
figures  30  and  31  allows  one  to  obtain  a  rough  estimate  of  the  magnitude 
end  direction  of  error  for  each  of  the  standards. 

GENERAL  DISCUSSION  AND  CONCLUSIONS 

Display  slss  was  found  to  have  an  effect  on  the  accuracy  of  roll 
angle,  pitch  angle,  and  altitude  judgments,  but  the  nature  of  the  effect 
depended  upon  the  type  of  judgment  (absolute  judgments  ve  detection  of 
change)  and  the  magnitude  of  the  standard  being  judged.  The  generali¬ 
sation  can  be  mada  that  display  sice  had  little  effect  on  the  accuracy 
with  which  absolute  judgments  of  the  thrae  flight  parameters  can  be  made, 
although  there  wee  a  tendency  for  judgment  accuracy  to  improve  with  die- 
play  Slsa,  when  £0  were  judging  altitudes  greater  then  250  feet. 

Display  else  wea  consistently  found  to  have  an  effect  on  the  accuracy 
with  which  an  assigned  value  of  one  of  the  parameters  can  be  maintained. 
Intermediate  else  displays  resulted  in  the  moat  accurate  maintenance  of 
altitude  and  pitch  angle  regardless  of  the  magnitude  of  the  standard, 
although  the  “optimum*'  size  display  varied  somewhat  ae  a  function  of  the 
standard.  Considering  the  altitude  end  the  pitch  angle  studies  jointly 
. the  optignim  display  else  fell  between  8  and  13  inches  regardless  of  the 
value  of  the  standard.  The  display  most  frequently  found  optimum  in 
these  studies  was  the  11-inch  display.  In  contrast,  a  rather  striking 
interaction  bstwsen  displey  also  end  magnitude  of  the  roll  angle  standard 
Ms  found.  Larger  displays  were  favored  if  the  standard  was  less  than 
16  dagraas,  whereas,  smaller  displays  wars  beet  if  the  standard  was  greater 
than  18  dagraas.  The  display  size  that  appeared  to  maximize  Judgment 
accuracy  across  ell  roll  angles  wea  the  11  inch  displey. 

When  the  results  of  these  experiments  era  considered  as  a  unit,  the 
11-inch  display  would  appear  to  be  optimum.  However,  the  reader  Is 
cautioned  against  accepting  this  figure  without  first  r.onsiderning  the 
relative  priority  of  the  judgments  which  will  be  performed  with  the  dis¬ 
play  end  the  values  of  standards  that  will  be  judged  in  a  particular 
flight  situation,  If  a  flight  situation  were  encountered  in  which  it  was 
urgent  that  the  pilot  be  able  to  Identify  1000-feet  altitude  with  a  high 
degree  of  accuracy,  e  17-inch  display ,  rather  then  an  11-lnch  display 
would  be  considered  optimum.  One  of  the  prime  reasons  for  defining 
relationships  among  variables  was  to  permit  the  making  of  such  decisions. 

The  reader  le  also  cautioned  agalnat  generalizing  this  figure  without  regard 
to  the  distance  at  which  the  displey  will  be  viewed.  Actually,  display  size 


should  have  bean  expressed  throughout  this  report  In  terms  of  degrees  of 
visual  angle  subtended  by  the  displays.  However,  to  have  done  so  would 
have  been  burdensome  to  both  the  writer  and  the  reader.  If  one  intends 
to  generalise  the  results  of  these  experiments  to  situations  in  which 
viewing  distance  is  not  the  same  as  that  used  here,  all  display  sites 
should  be  converted  to  units  of  visual  angle  in  order  to  make  the  two 
siuations  equivalent. 

To  aid  in  this  conversion,  a  table  is  provided  in  appendix  A  which 
lists  the  measured  height,  width,  and  diagonal  dimensions  of  the  picture 
shown  on  commercial  CRT  tubes  varying  from  5  inches  to  17  inches  In 
increments  of  one  inch.  The  corresponding  visual  angle  subtended  at  a 
32-inch  viewing  distance  is  shown  adjacent  to  each  measured  dimension. 

Generalisations  as  to  the  accuracy  with  which  the  flight  parameters 
can  be  judged  cannot  be  made  because  of  the  dependency  of  judgment 
accuracy  upon  both  display  else  and  the  value  of  the  standard  being 
judged.  However,  the  regression  equations  derived  or  the  figures 
presented  here  can  be  used  to  cstlsate  tha  expected  judgment  accuracy 
for  any  specific  condition  of  Interest  within  the  range  of  values 
investigated.  Again  a  word  of  caution  regarding  the  interpretation  of 
these  results.  The  accuracy  attained  in  these  experiments  should  not 
be  generalised  to  complex  flight  situations.  These  experiments  wars 
concerned  with  decoding  accuracy  under  near  optimal  conditions.  Tha 
introduction  of  increased  perceptual  loading  or  more  complex  encoding 
tasks  would  undoubtedly  result  in  decreased  accuracy.  These  data  are 
to  be  used  as  baseline  data  in  determining  whether  judgments  can  be 
made  with  sufficient  accuracy  to  meat  system  requirements.  If  judgments 
In  this  near  optimum  condition  are  not  sufficiently  accurate  to  meet 
system  requirements,  one  can  be  aura  that  the  display  will  require 
supplementation  in  a  more  complex  situation.  If  accuracy  decreases  as 
the  complexity  of  the  task  increases,  these  baseline  data  will  provide 
the  knowledge  that  tha  magnitude  of  the  error  is  not  due  to  tha  observer's 
inability  to  decode  the  display  but  to  other  factors  such  as  task  loading, 
display/control  incompatibility,  task  complexity,  etc. 

One  of  the  most  valuable  products  of  this  series  of  experiments  was 
the  identlfcatlon  of  the  types  of  cues  which  Ss  tend  to  use  in  making 
various  types  of  judgments.  Although  these  cues  are  too  numerous  to  list 
here,  it  can  be  stated  that  nearly  all  j3s  showed  a  tendency  to  "externalise" 
their  judgments.  That  is,  Ss  tended  to  search  for  two  stable  references 
on  the  display  and  attempted  to  maintain  a  constant  spatial  relationship 
between  these  two  points.  Yet,  when  these  constant  rsfersncss  were  elimi¬ 
nated,  it  was  found  that  8a  ware  capable  of  learning  to  judga  tha  parameters 
accurately  using  "internaT"  references  (memory  presumably).  Savsral  cuas 
proved  to  be  unexpectedly  powerful,  while  others  proved  of  less  value  than 
was  originally  presumed.  Systematic  statements  as  to  the  relstiva  value 
of  the  various  types  of  cues  on  the  VCAD  must,  however,  awsit  further  research. 
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’The  purpose  of  this  document  is  to  (apart  the  first  results  from  a  series  at  experiments  establish!]* 
and  optimising  the  utility  of  the  Vortical  Contact  Analog  Display  (VCAD).  The  VCAD  concept  in  that 
at  a  computer-generated  pictorial  display  which  provides  the  observer  with  visual  cues  as  to  aircraft 
orientation.  Those  cues  are  analogous  to  those  available  under  contact  night  conditions.  The  specific 
objectives  at  thia  experiment  a  arias  worst  (1)  to  establish  the  relationship  between  also  of  VCAD  dis¬ 
play  aad  Judgment  accuracy  for  altitude,  pitch,  aad  roll  estimates,  and  (3)  to  obtain  estimates  at  the 
accuracy  with  which  these  quantities  may  be  Judged.  Four  studies  were  conducted  to  xmasure  gp 
ability  to  "sselntaln"  a  given  standard  against  a  forcing  function  and  throe  studios  wars  candimtnd  to 
measure  la  ability  to  recall  aad  utilise  an  “internalised  standard.'*  Both  types  of  experiments  xrers 
conducted  for  each  at  the  throe  flight  related  quantities.  The  experimental  designs  for  each  of  these 
experiments  were  fractional  replicates  with  repeated  measures.  The  analytic  procedure  consisted  of 
the  fitting  of  "responses  surface"  models  and  the  graphical  reposentation  of  those  models.  It  was 
concluded  that  display  also  had  an  effect  on  the  accuracy  for  each  of  the  throe  flight  quantities,  but 
the  nature  of  the  affect  depended  on  both  the  type  of  Judgment  task  (“maintenance"  versus  recalled 
“standard")  aad  the  magnitude  of  tha  standard  being  judged.  Generally,  the  affect  was  more  pro¬ 
nounced  for  the  “maintenance"  experiments.  The  results  of  the  experiments  as  a  unit  suggest  tha 
optimal  display  traverses  a  diagonal  visual  angle  of  16.6  degrees  for  commercial-rectangular  displays 
(e.g.,  a  commercially  designated  11-inch  display  at  a  33-inch  viewing  distance).  (  j 
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